Avoid Multiple Instances of Jobs in Director Log.

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
Aquilis
Participant
Posts: 204
Joined: Thu Apr 05, 2007 4:54 am
Location: Bangalore
Contact:

Avoid Multiple Instances of Jobs in Director Log.

Post by Aquilis »

Hi all,
I have Multiple Instance JobControl Code which Executes again 4 Multiple Instances Jobs.I can't guess how many multiple instances of job control can be invoked at a time,It may vary from 10 to 20 Instances at a time.So which will inturn invoke more number of multi instance jobs involved in it.
So all these instances are clearly viewable in Director log.Assuming if i have nearly triggering 30 instances all jobs,then all these are clearly viewed from Director log,which i dont want to happen.I know if compile my base jobs then all the instances will get deleted.But i cant go ahead with it,since my jobcontrol is triggered continously 24*7 from MQ message pulling job.Continuously my MQ plugin will pullout the messages and triggers the jobcontrol.So in this case my instances will keep on increasing.
So i cant guess when should i compile my base jobs,i cant predict the Time Lag.

So, is there any way so that i can revoke the viewable picture of creation of instances in the Director Log. Can i do like just showing the Base Jobs other than all the instances log viewable.
You suggestions will really help me out in this regard.

Thank you all,
Aquilis
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

I can think of 2 things:
a) filtering Director entries
b) Automatic purging - this will remove the instance name when the log is purged.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I agree. Other than filtering by job name (for example not matching *.*)there is no means in Director to achieve what you appear to be asking. But what is it you really want? If all runs supply an invocation ID the "base job" will contain no entries. Also, you won't be aware that the log table for the multi-instance job may be growing and growing - auto-purge does not occur unless the job finishes normally (no errors).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
shawn_ramsey
Participant
Posts: 145
Joined: Fri May 02, 2003 9:59 am
Location: Seattle, Washington. USA

Post by shawn_ramsey »

ArndW wrote:I can think of 2 things:
a) filtering Director entries
b) Automatic purging - this will remove the instance name when the log is purged. ...
Unfortunately automatic purging only clears logs and will not remove the invocation information.
Shawn Ramsey

"It is a mistake to think you can solve any major problems just with potatoes."
-- Douglas Adams
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Shawn - I remember now, I had to write a short DS/BASIC program that goes into the log and cleanses "orphaned" information. I think that might be fixed at V8 and can check that next week. I might also have the code on my PC which cleans up the log and can post it here.
Aquilis
Participant
Posts: 204
Joined: Thu Apr 05, 2007 4:54 am
Location: Bangalore
Contact:

Post by Aquilis »

Except the Base Jobs,all other instances of these jobs should not list in the Director Log.That's what my question is ?.
Is there any option in DS to Hide all executing and executed instances of jobs from director list.
Aquilis
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

From the Status view in the Director, Control-T or View/Filter Entries will show you all of the available options to filter the display of jobs there.
-craig

"You can never have too many knives" -- Logan Nine Fingers
shawn_ramsey
Participant
Posts: 145
Joined: Fri May 02, 2003 9:59 am
Location: Seattle, Washington. USA

Post by shawn_ramsey »

ArndW wrote:Shawn - I remember now, I had to write a short DS/BASIC program that goes into the log and cleanses "orphaned" information. I think that might be fixed at V8 and can check that next week. I might also have the code on my PC which cleans up the log and can post it here.
Good news is that runtime information is still stored in Universe in V8 so the old work around will still work around. :D
Last edited by shawn_ramsey on Wed Jan 02, 2008 5:30 pm, edited 1 time in total.
Shawn Ramsey

"It is a mistake to think you can solve any major problems just with potatoes."
-- Douglas Adams
JoshGeorge
Participant
Posts: 612
Joined: Thu May 03, 2007 4:59 am
Location: Melbourne

Post by JoshGeorge »

If "Hide all executing and executed instances of jobs from director list" is what you want then I think as noted by Ray and Craig filtering by job name will be your only option.
Aquilis wrote:Except the Base Jobs,all other instances of these jobs should not list in the Director Log.That's what my question is ?.
Is there any option in DS to Hide all executing and executed instances of jobs from director list.
Joshy George
<a href="http://www.linkedin.com/in/joshygeorge1" ><img src="http://www.linkedin.com/img/webpromo/bt ... _80x15.gif" width="80" height="15" border="0"></a>
Post Reply