populating job statistics in an audit table
Moderators: chulett, rschirm, roy
populating job statistics in an audit table
Dear All,
I have a requirement where there is a sequence with 5 jobs and the sequence is executed from a shell script. I would like to have the execution statistics of each job in an audit table with structure(load_id,status,recordcount_read,recordcount_loaded,load_date).Need help on how can I capture the read and loaded record counts of a job.Is it possible to do it from a shell script after the job has finished?I have seen a few DS functions but though we can certainly capture start and end time from them,not sure whether input and output record counts can be found out.Need some help.
Regards,
Ayan
I have a requirement where there is a sequence with 5 jobs and the sequence is executed from a shell script. I would like to have the execution statistics of each job in an audit table with structure(load_id,status,recordcount_read,recordcount_loaded,load_date).Need help on how can I capture the read and loaded record counts of a job.Is it possible to do it from a shell script after the job has finished?I have seen a few DS functions but though we can certainly capture start and end time from them,not sure whether input and output record counts can be found out.Need some help.
Regards,
Ayan
There are a ton of discussions here on that subject, so be prepared to search and dig. One decent starting point would be here:
viewtopic.php?t=130037
viewtopic.php?t=130037
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
Thanks for your reply.I understand that job stats could be found out from a shell script using various dsjob switches (logsum ,logdetail,lownewest ) . However after consulting server job developer guide,I don't find out any of them giving out no. of records read and records loaded.Though certainly jobname,status,start and endtime can be captured.I have been using informatica for sometime but very new to datastage.Could you kindly provide some specific guidance?Yes,I searched the forum and found some very useful posts but still could not get this record count capturing code right.
Process is easier for Server jobs, luckily. You can get the information from the 'Finishing' records in the log or by checking specific links in the jobs using DSGetLinkInfo with the DSJ.LINKROWCOUNT info type. From the command line, you could parse it from the dsjob -linkinfo output.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
Want to capture job end timestamp
Hi,ayan wrote:ok.got the idea.will try that out.Thanks.I am very new to this forum but must say,a very dynamic forum with lot of useful info.Very useful for beginners like me.
How job end time can be captured in datastage.
Anil
Want to capture job end timestamp
Hi,ayan wrote:ok.got the idea.will try that out.Thanks.I am very new to this forum but must say,a very dynamic forum with lot of useful info.Very useful for beginners like me.
How job end time can be captured in datastage.
Anil
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Code: Select all
DSGetJobInfo(hJob, DSJ.JOBENDTIMESTAMP)
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
How to capture job end time
Hi Ray,ray.wurlod wrote:...Code: Select all
DSGetJobInfo(hJob, DSJ.JOBENDTIMESTAMP)
Thanks a lot for your reply. I am quite new to datastage, could you please bit clear where to write this code to capture job end time.
Regards