Deleting the Logs in director for instance jobs

suneyes · Post by **suneyes** » Fri Feb 17, 2012 1:41 am

Good Evening All,

There is Datastage sequence job built as part of once off history load,which would run iteratively using the loops in datastage.

We have passed the looping counter as a parameter for job instances. So for each job run, there is an instance job entry created in data stage director.

JOB1 --compiled
JOB1.1 --finished
JOB1.2 --finished
JOB1.3 --finished
JOB1.4 --finished
JOB1.5 --finished
JOB1.6 --finished

This sequence job calls around 20 datastage jobs/sequences.
As this sequence(loop) would run for around 300 times,we got a huge list of instance jobs in the director.it has now become impossible to open datastage director for monitoring the jobs as the refresh interval was set to 5 seconds.

As we dont need the job logs for the instance jobs any mnore,we are planning to drop all the instance logs created in from director.

We are taking care not to delete the actual job from the director so that the whole job gets deleted.We would only delete all the instances of the jobs.

can you please let me know,if we can go ahead with this approach or you see any problems with this?

qt_ky · Post by **qt_ky** » Fri Feb 17, 2012 6:57 am

Log into some other project in Director and change the refresh interval to some high number.

Then log into the project you mentioned having a large number of instances and job logs. Use Director to enable Auto-purge settings on the main, compiled job. Clear the job log immediately if you want to on the main, compiled job which has the overall job log of all instances. Both of these options are under the Job menu --> Clear Log...

You can also recompile the main job and you should find no need to delete job instances one by one.

DSguru2B · Post by **DSguru2B** » Fri Feb 17, 2012 8:54 am

But I would suggest saving the logs in a flat file or table which will help during debugging. You dont want to be without your joblog when trying to debug your job.

ray.wurlod · Post by **ray.wurlod** » Fri Feb 17, 2012 4:27 pm

You can delete the "instance" entries from RT_STATUSnnn and you will find that the instance log entries magically disappear.

suneyes · Post by **suneyes** » Tue Feb 28, 2012 12:05 am

Thanks Ray and DSguru2B. I took the path of recompiling the jobs which worked for me.Thanks once again.