ETLstats
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
ETLstats
Kim Duke's utility ETLstats is now also hosted on OneDrive and can be accessed from here - you should not use right click initially (as it will try to save a redir HTML).
Download both ETLstats.zip and Scripts.zip from the OneDrive folder.
Download both ETLstats.zip and Scripts.zip from the OneDrive folder.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
I think there is too much stuff in EtlStats. I am working on a EtlStatsLite version. Hopefully my new boss will let me post the bare minimum to get row counts in tables. If not then I can walk you thru it. Hopefully Ray will add it to the downloads. Let you know when I am done.
If interested then post a reply. I think all I need is 2 jobs and 3 routines. Just create tables, import jobs, compile and run.
If interested then post a reply. I think all I need is 2 jobs and 3 routines. Just create tables, import jobs, compile and run.
Mamu Kim
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
I will not be able to post my solution. So it is very simple. All you need is the DsJobReport job and the Driver job that goes with it. Rename the jobs EtlGetRowCounts and EtlGetRowCountsDriver. Next get rid of KimD\ all the paths. Get rid of the hashed files. Get rid of the lookup for job status description. There is a routine to give the job status description. So now all you need 3 routines. 2 routines to fix elapsed time and elapsed seconds. You don't need these if you trust what is in the XML file. The other routine is the job status description one already described.
EtlStatsLite, someone do this and zip it up and give to Ray.
Thanks Kim.
EtlStatsLite, someone do this and zip it up and give to Ray.
Thanks Kim.
Mamu Kim
I noticed that where you get link name and row counts is different in PX jobs. You need to import the XML. Load the new Xpaths to get to instanceLinkName and instanceRowCount. You need to change the repeating element to the new link name above. Now you need to add stage name. You have to sort by stage name and the new link name. Then you need to aggregate all the instance row counts. You need to add stage name to the ETL_ROW_HIST table.
Post if you get it working.
Post if you get it working.
Mamu Kim
-
- Participant
- Posts: 1
- Joined: Tue Jul 22, 2014 6:53 am
Not working; seems to be problem on page?
I tried. Got msg saying try to turn on TLS this, TLS that, etc.
I guess our security just will not let me access it.
What a shame. It looks useful!
john3
I guess our security just will not let me access it.
What a shame. It looks useful!
john3
john3
----------------------------------------------------
InfoSphere 8.5.0.2; DataStage 8.5.0.0; OS-RHEL 6.6; DB-Oracle Enterprise Edition 11g (11.2.0.4)
----------------------------------------------------
InfoSphere 8.5.0.2; DataStage 8.5.0.0; OS-RHEL 6.6; DB-Oracle Enterprise Edition 11g (11.2.0.4)
MESSAGE IN FF:
Secure Connection Failed
An error occurred during a connection to onedrive.live.com. SSL received a record that exceeded the maximum permissible length. Error code: SSL_ERROR_RX_RECORD_TOO_LONG
The page you are trying to view cannot be shown because the authenticity of the received data could not be verified.
Please contact the website owners to inform them of this problem.
Secure Connection Failed
An error occurred during a connection to onedrive.live.com. SSL received a record that exceeded the maximum permissible length. Error code: SSL_ERROR_RX_RECORD_TOO_LONG
The page you are trying to view cannot be shown because the authenticity of the received data could not be verified.
Please contact the website owners to inform them of this problem.
john3
----------------------------------------------------
InfoSphere 8.5.0.2; DataStage 8.5.0.0; OS-RHEL 6.6; DB-Oracle Enterprise Edition 11g (11.2.0.4)
----------------------------------------------------
InfoSphere 8.5.0.2; DataStage 8.5.0.0; OS-RHEL 6.6; DB-Oracle Enterprise Edition 11g (11.2.0.4)
Kim's website is dead. Only way to get the routines is from Ray Wurlod's site...
http://www.raywurlod.com/
http://www.raywurlod.com/