Reading datastage log files in unix

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
MukundShastri
Premium Member
Premium Member
Posts: 103
Joined: Tue Oct 14, 2003 4:07 am

Reading datastage log files in unix

Post by MukundShastri »

We need to read the unix log files of datastage jobs from operating system and use them as an input to HP openview.
Is it possible to read the jobwise files (I know they are numbered for a job) and can they be used as an input for some tools like HP openview which can give conise summary of failed jobs on their screen using these log files ?
Early reply will be appreaciated.

thanks

Mukund
ogmios
Participant
Posts: 659
Joined: Tue Mar 11, 2003 3:40 pm

Re: Reading datastage log files in unix

Post by ogmios »

dsjob (search on this site) will allow you to read a log (it's part of DataStage on the server). Some problems:
you have to specify the name of the job you want to see the logfile of. If you have a lot of jobs it takes an awful lot of time and resources to do all, ...

I created similar stuff to integrate with Tivoli to monitor some sequencer jobs. To do it for all jobs will probably too much of a workload.

Ogmios
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You could create a DataStage job to dump the requisite contents from DataStage job logs into, for example, delimited text files.

You could then create a job control routine to process a particular selection of jobs in the project (maybe all of them, maybe just the ones with a status of DSJS.RUNWARN, DSJS.FAILED or DSJS.CRASHED), for each of these executing your "dump log" job.

Metadata for the RT_LOGnnn files is excluded from being imported, but can be listed. It has, in the past, been posted on this forum, too.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
bikan
Premium Member
Premium Member
Posts: 128
Joined: Thu Jun 08, 2006 5:27 am

Post by bikan »

can anybody tell me how to create job to dump the requisite contents from DataStage job logs into, for example, delimited text files.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Source is either a Hashed File stage or UniVerse stage. Table name is RT_LOGnnn, where nnn is the job number from DS_JOBS. I assume you can use a Sequential File stage to create your delimited text file. Search the forum for the column definitions in RT_LOGnnn. You will need to create them in the Repository, since they are explicitly blocked from being imported. Though I think I may once have described a workaround for that.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply