One generic job to extract data from all tables
Posted: Mon Oct 20, 2014 8:59 am
Hi,
I'm getting back to DataStage after a couple of years, so I apologize first in case the question below has been answered earlier. I tried searching but did not get the answer.
I have 130 Tables in my ODS schema. Data from all these tables needs to be extracted everyday by using last_update_dt column. Everyone in my team is suggesting that they would write 130 jobs to extract data from each table. But I think it can be done in one generic job since all columns need to be extracted from each table.
I had done something similar 5 years back, something with RCP column..but age is playing tricks with memory. I had something like a for loop passing all table names to this one multi instance job.
Someone please tell me it can be done in one job rather than 130 jobs.
-Regards
Wah
I'm getting back to DataStage after a couple of years, so I apologize first in case the question below has been answered earlier. I tried searching but did not get the answer.
I have 130 Tables in my ODS schema. Data from all these tables needs to be extracted everyday by using last_update_dt column. Everyone in my team is suggesting that they would write 130 jobs to extract data from each table. But I think it can be done in one generic job since all columns need to be extracted from each table.
I had done something similar 5 years back, something with RCP column..but age is playing tricks with memory. I had something like a for loop passing all table names to this one multi instance job.
Someone please tell me it can be done in one job rather than 130 jobs.
-Regards
Wah