dataset issue
Posted: Thu Sep 20, 2012 12:00 am
Hi All,
I have designed two jobs. First job has some processing logic and the out put is written to a dataset. this dataset created is used as reference in my second jbb. the second job flow is : db2 --> join with data from dataset -->output to a file.
The problem i am facing is that, when i create the dataset there are 2 lakh records. . but in my second job when i read same ds, it reads only 99,000 records. there are no warnings, no errors in both the jobs.
but if i change my second job design to dataset-->transformer --> then join with db2.. all records are being read.
why is the dataset when used with join reading less no of rows?
Thank you very much in advance.
I have designed two jobs. First job has some processing logic and the out put is written to a dataset. this dataset created is used as reference in my second jbb. the second job flow is : db2 --> join with data from dataset -->output to a file.
The problem i am facing is that, when i create the dataset there are 2 lakh records. . but in my second job when i read same ds, it reads only 99,000 records. there are no warnings, no errors in both the jobs.
but if i change my second job design to dataset-->transformer --> then join with db2.. all records are being read.
why is the dataset when used with join reading less no of rows?
Thank you very much in advance.