Data Stage Scheduling Issue
Posted: Fri Nov 14, 2003 1:53 pm
Hi,
I am new to DataStage, and I have a question regarding to DataStage scheduling. Currently, I am participating a project which tries to convert hard-coded ETL to Datastage, but I've had this big issue about the scheduling. In our old system, the scheduler has lots of flexibility. Every time, it starts, the scheduler checks the table in source database to decide which data (all the data are date related ) is available to be processed. Then it inserts those dates into a table called job_process_date_list. In the second step, it fetched the rows from job_process_date_list, then for each date, it executes a bunch of stored procedure with the date as parameter. (The stored procedures name is stored in a table. ) until all the dates in job_process_date_list are processed. I am wondering how to implement such mechanism in DataStage.
Thanks,
Yiming
I am new to DataStage, and I have a question regarding to DataStage scheduling. Currently, I am participating a project which tries to convert hard-coded ETL to Datastage, but I've had this big issue about the scheduling. In our old system, the scheduler has lots of flexibility. Every time, it starts, the scheduler checks the table in source database to decide which data (all the data are date related ) is available to be processed. Then it inserts those dates into a table called job_process_date_list. In the second step, it fetched the rows from job_process_date_list, then for each date, it executes a bunch of stored procedure with the date as parameter. (The stored procedures name is stored in a table. ) until all the dates in job_process_date_list are processed. I am wondering how to implement such mechanism in DataStage.
Thanks,
Yiming