Job level Auditing in Datastage 8.1

mekrreddy · Post by **mekrreddy** » Thu Apr 16, 2009 12:43 pm

Does any one have idea of auditing the datastage job in the job level for no.of records extracted, transformed, inserted or rejected. I have been using @INROWNUM which is not a workaround.

Thank you.

ray.wurlod · Post by **ray.wurlod** » Thu Apr 16, 2009 4:49 pm

The DataStage API functions remain viable in version 8.1; you can download ETLstats and adapt its techniques.

If you have it and you are generating operational metadata, then you can use Metadata Workbench to perform these analyses.

HOWEVER, to have this work generically, you need a consistent naming convention for those links that read, write, handle rejects, read by key, and other ("transformation?").

chulett · Post by **chulett** » Thu Apr 16, 2009 5:43 pm

You might also consider running DSJobReport 'after job' and processing its output for auditing purposes.

mekrreddy · Post by **mekrreddy** » Fri Apr 17, 2009 8:58 am

Is there any way to load the job report stats into the audit table at the same time when job runs without adding any processing stages...

ray.wurlod · Post by **ray.wurlod** » Fri Apr 17, 2009 3:09 pm

The after-job subroutine could look after that. But why write code when you have a perfectly good GUI? Certainly the after-job subroutine can capture the data, but it could also run a small job to write them into your audit table.

mekrreddy · Post by **mekrreddy** » Mon Apr 20, 2009 2:03 pm

well, could you please tell in detail how to do that?, i like to write every small job log too.. Ray, you are the man of datastage

thank you.