Production Dataset Issue

sureshreddy2009 · Post by **sureshreddy2009** » Tue May 24, 2011 8:22 am

Hi,
My production datastage flow is
We have extract jobs loading from flat files to staging oracle database.
From staging database data quality datastage job will run and load into dataset. From there Data transformation job will run, this will extract the data from previous dataset and load into insert ready file which will insert the records into target oracle database.

Now the issue is
Some alternative days in production, the Data quality(DQ) job will load 48 records into dataset, the data transformation(DT) job will not read the records and process 0 records even the dataset is created ,jobs are successfull. And on another day DQ load 50 records, but DT will process 34 records, which were immediate previous day batch records. The production batch is running accurately for other days.
Can any one give some thoughts on this
Thanks in advance

chulett · Post by **chulett** » Tue May 24, 2011 9:01 am

Sounds like you have a synchronization / timing issue.

sureshreddy2009 · Post by **sureshreddy2009** » Tue May 24, 2011 9:34 am

Can you please eloborate the cause.

sureshreddy2009 · Post by **sureshreddy2009** » Tue May 24, 2011 11:32 am

Hi greggknight,

I know the meaning and definition you copied and pasted from a dictionary site

I mean to eloborate some more causes other than synchronization.
If you know the reasons post here

greggknight · Post by **greggknight** » Tue May 24, 2011 11:43 am

I am sure you do,
So then take the definition,
Look at the flow of your jobs makeing sure they run in the correct order and no other job is writing to the wrong dataset over writting your results.

The Problem appears to be your design.
This is not a datastage issue this is a developer issue.

sureshreddy2009 · Post by **sureshreddy2009** » Tue May 24, 2011 11:53 am

Issue Resolved,
more over there will never be datastage problem
Its always developer work matters. I came to know yesterday the sequence is failed. When I triggered that event it started from that point and that dataset contains yesterday records.

Thanks,

sureshreddy2009 · Post by **sureshreddy2009** » Tue May 24, 2011 11:54 am

Issue Resolved,
more over there will never be datastage problem
Its always developer work matters. I came to know yesterday the sequence is failed. When I triggered that event it started from that point and that dataset contains yesterday records.

Thanks,