How to manually set job status based on the result of query
Posted: Mon Dec 01, 2003 1:42 pm
I have a problem regarging to capture logic errors within ETL. To keep the siutation simple, I am giving a sample here.
There are several jobs related a fact tables. We can separate the jobs into 2 groups, one group handles dimension mapping ( one job handles one dimension), it maps the source key within fact table to surrogate keys in datamart. Second group of job does all the calculation or transformation. Obviously, second group of job should be executed after first group. What we want to accomplished is that at the end of first group of job, we check whether all the source_key in fact table has its corresponding surrogate key, if any surrogate key is missing, we want set the job status as 'failure', and second groups of job would not start at all.
I don't know whether it is doable in datastage, or I have to let the process continue until the later process catches the error.
There are several jobs related a fact tables. We can separate the jobs into 2 groups, one group handles dimension mapping ( one job handles one dimension), it maps the source key within fact table to surrogate keys in datamart. Second group of job does all the calculation or transformation. Obviously, second group of job should be executed after first group. What we want to accomplished is that at the end of first group of job, we check whether all the source_key in fact table has its corresponding surrogate key, if any surrogate key is missing, we want set the job status as 'failure', and second groups of job would not start at all.
I don't know whether it is doable in datastage, or I have to let the process continue until the later process catches the error.