Page 1 of 1

Production Dataset Issue

Posted: Tue May 24, 2011 8:22 am
by sureshreddy2009
Hi,
My production datastage flow is
We have extract jobs loading from flat files to staging oracle database.
From staging database data quality datastage job will run and load into dataset. From there Data transformation job will run, this will extract the data from previous dataset and load into insert ready file which will insert the records into target oracle database.

Now the issue is
Some alternative days in production, the Data quality(DQ) job will load 48 records into dataset, the data transformation(DT) job will not read the records and process 0 records even the dataset is created ,jobs are successfull. And on another day DQ load 50 records, but DT will process 34 records, which were immediate previous day batch records. The production batch is running accurately for other days.
Can any one give some thoughts on this
Thanks in advance

Posted: Tue May 24, 2011 9:01 am
by chulett
Sounds like you have a synchronization / timing issue.

Posted: Tue May 24, 2011 9:34 am
by sureshreddy2009
Can you please eloborate the cause.

Posted: Tue May 24, 2011 11:32 am
by sureshreddy2009
Hi greggknight,

I know the meaning and definition you copied and pasted from a dictionary site :o

I mean to eloborate some more causes other than synchronization.
If you know the reasons post here

Posted: Tue May 24, 2011 11:43 am
by greggknight
I am sure you do,
So then take the definition,
Look at the flow of your jobs makeing sure they run in the correct order and no other job is writing to the wrong dataset over writting your results.

The Problem appears to be your design.
This is not a datastage issue this is a developer issue.

Posted: Tue May 24, 2011 11:53 am
by sureshreddy2009
Issue Resolved,
more over there will never be datastage problem
Its always developer work matters. I came to know yesterday the sequence is failed. When I triggered that event it started from that point and that dataset contains yesterday records.

Thanks,

Posted: Tue May 24, 2011 11:54 am
by sureshreddy2009
Issue Resolved,
more over there will never be datastage problem
Its always developer work matters. I came to know yesterday the sequence is failed. When I triggered that event it started from that point and that dataset contains yesterday records.

Thanks,