Production Dataset Issue
Posted: Tue May 24, 2011 8:22 am
Hi,
My production datastage flow is
We have extract jobs loading from flat files to staging oracle database.
From staging database data quality datastage job will run and load into dataset. From there Data transformation job will run, this will extract the data from previous dataset and load into insert ready file which will insert the records into target oracle database.
Now the issue is
Some alternative days in production, the Data quality(DQ) job will load 48 records into dataset, the data transformation(DT) job will not read the records and process 0 records even the dataset is created ,jobs are successfull. And on another day DQ load 50 records, but DT will process 34 records, which were immediate previous day batch records. The production batch is running accurately for other days.
Can any one give some thoughts on this
Thanks in advance
My production datastage flow is
We have extract jobs loading from flat files to staging oracle database.
From staging database data quality datastage job will run and load into dataset. From there Data transformation job will run, this will extract the data from previous dataset and load into insert ready file which will insert the records into target oracle database.
Now the issue is
Some alternative days in production, the Data quality(DQ) job will load 48 records into dataset, the data transformation(DT) job will not read the records and process 0 records even the dataset is created ,jobs are successfull. And on another day DQ load 50 records, but DT will process 34 records, which were immediate previous day batch records. The production batch is running accurately for other days.
Can any one give some thoughts on this
Thanks in advance