performance statistics

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
via
Premium Member
Premium Member
Posts: 118
Joined: Fri Sep 23, 2005 3:10 pm

performance statistics

Post by via »

Hi,
We are using datastage v8.0.1 on AIX.The requirement is to collect job performance statistics like when job started, finished; how many rows processed finally;how many rows rejected; cpu utilisation.....

Can anybody help me to catch those details for a datastage job! when we generate a report on a job, it gives all details except what we required!
I appreciate any help in this.
Thanks.
Via
-------------------------------------
Learn all the way, as you Grow each Second
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

If the dsjob command is the same for 8.0 as well then you should look at dsjob -report and get all the information from there. Go through the manuals, there should be more in-built reporting abilities of 8.0
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
via
Premium Member
Premium Member
Posts: 118
Joined: Fri Sep 23, 2005 3:10 pm

Post by via »

Thanks Brian for your prompt response.
I am novice in datastage.Where to use that Dsjob command.Is it by adding execute command activity at the end in job sequence? or is there any location where datastage engine automatically stores all job details?

Regards
Via
-------------------------------------
Learn all the way, as you Grow each Second
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Read about dsjob command in developers guide under command line. Its basically run at the unix level. dsjob -report will give a report of the job that will contain the start time, end time, the elapsed time, job status etc.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
via
Premium Member
Premium Member
Posts: 118
Joined: Fri Sep 23, 2005 3:10 pm

Post by via »

Thanks sree
Via
-------------------------------------
Learn all the way, as you Grow each Second
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You should be able to report these directly using Analyis Server.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
via
Premium Member
Premium Member
Posts: 118
Joined: Fri Sep 23, 2005 3:10 pm

Post by via »

Hi all,
The issue solved.In DS v8.0.1, when we check the option catch operational meta data in DS ADMINISTRATOR, When ever a job runs, operational meta data is stored in xml files.We can access those XML files.It got all information related job run..

Thanks for all responses.
Via
-------------------------------------
Learn all the way, as you Grow each Second
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

Sounds like you still need EtlStats to load this into a table. Not good.
Mamu Kim
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

It's not stored in XML files; it's stored in the common repository. XML is merely one way to report.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

I hope so.
Mamu Kim
Post Reply