Hi,
Is there a way to get the performance statistics in the log file like I would like to have the information for each link with link name and number of records processed for that link in the log file. Is there a way to accomplish this. Please do reply as we are facing this requirement in our project right now.
Performance statistics in a log file
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 7
- Joined: Thu Oct 14, 2004 12:48 pm
Go to either my tips page or ADN and download EtlStats.zip. This is a few jobs to get row counts and store them in tables. Do a search. I have explained this in detail on both web sites. Very easy to run and setup. We store row counts in our data warehouse so we can look back over time and see if a job is slowing down.
I have several more jobs which I need to post to link ETL_ROW_HIST to ETL_JOB to get the job category. I now also have ETL_TABLE which will allow you to report by table name instead of just job and link name. I may have included the jobs to update ETL_JOB already. I have to look. I have been busy. We went live with phase 1 this week. I should post it soon.
This history of run times and row counts are very important. I would like to get mb/sec added soon like Ray suggested this week. Rows/sec are already there.
If anyone has used these then please let me know. Also if you have made improvements then let me know. You will not hurt my feelings if you improved any of these jobs. Post your solutions where all can see them either here or ADN.
I have several more jobs which I need to post to link ETL_ROW_HIST to ETL_JOB to get the job category. I now also have ETL_TABLE which will allow you to report by table name instead of just job and link name. I may have included the jobs to update ETL_JOB already. I have to look. I have been busy. We went live with phase 1 this week. I should post it soon.
This history of run times and row counts are very important. I would like to get mb/sec added soon like Ray suggested this week. Rows/sec are already there.
If anyone has used these then please let me know. Also if you have made improvements then let me know. You will not hurt my feelings if you improved any of these jobs. Post your solutions where all can see them either here or ADN.
Mamu Kim
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
More detailed statistics about performance can be had by choosing the Tracing tab in the Job Run Options dialog (when you're about to run a job in Director), selecting an active stage from the list, and checking the Performance Statistics check box before clicking Run.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: