Multi-instance job log cleanup
Moderators: chulett, rschirm, roy
Multi-instance job log cleanup
I am creating multi-instance jobs that are intended to run only once. The same instance of the job will never be run again unless there is a failure and need to rerun.
My understanding is that auto-purge criteria is only considered the next time the instance runs.
I'm looking for a technique that will allow me to purge to multi-instance job log after it successfully completes. Otherwise, my Director log fills with instances that I no longer need or want.
My understanding is that auto-purge criteria is only considered the next time the instance runs.
I'm looking for a technique that will allow me to purge to multi-instance job log after it successfully completes. Otherwise, my Director log fills with instances that I no longer need or want.
Re: Multi-instance job log cleanup
No, it happens each time the job runs, regardless of instance.dls wrote:My understanding is that auto-purge criteria is only considered the next time the instance runs.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Just to be pedantic, log purge is initiated only if the job completes with no errors. That is, if the job aborts or is stopped, no automatic purge of log events occurs. That means that you can compare the current run's log with the previous.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
It has also been my observation that multi instance job logs only purge upon the next execution of that job+invocation id. The purge logic happens at the start of that cycle.
Notice I said observation. I am perfectly willing to be wrong on this one.
Our site also suffers from that type of log buildup as someone coded a date-stamp in the invocation ID of some jobs.
Notice I said observation. I am perfectly willing to be wrong on this one.
Our site also suffers from that type of log buildup as someone coded a date-stamp in the invocation ID of some jobs.
-
- Premium Member
- Posts: 425
- Joined: Sat Nov 19, 2005 9:26 am
- Location: New York City
- Contact:
...There is a bug in IIS8.7 that prevent the multi instances status records from being purged or cleared. The actual DS logs will be cleared as per the setting in the auto purged but not the name of the instances in the DS director view and will become slower and slower to refresh the logs due to the increasing number of empty records...
Fortunately there is patch for this bug patch_JR46141 ..just request the patch for your specific environment
Fortunately there is patch for this bug patch_JR46141 ..just request the patch for your specific environment
Last edited by JRodriguez on Tue Jan 17, 2017 5:38 pm, edited 1 time in total.
Julio Rodriguez
ETL Developer by choice
"Sure we have lots of reasons for being rude - But no excuses
ETL Developer by choice
"Sure we have lots of reasons for being rude - But no excuses
-
- Premium Member
- Posts: 425
- Joined: Sat Nov 19, 2005 9:26 am
- Location: New York City
- Contact:
Just in case this could help...
The purge rules apply only for new jobs. If you set the purge rules after deploying your DataStage jobs then logs won't be purge for those old jobs..you would need to redeploy them
The purge rules apply only for new jobs. If you set the purge rules after deploying your DataStage jobs then logs won't be purge for those old jobs..you would need to redeploy them
Julio Rodriguez
ETL Developer by choice
"Sure we have lots of reasons for being rude - But no excuses
ETL Developer by choice
"Sure we have lots of reasons for being rude - But no excuses
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Just wanted to add a comment to the post by PaulVL...
My current project is on 11.3 FP2 as well. Auto-purge of multi-instance jobs always clears our job log entries as expected. In the vast majority of cases, it also removes the instance so that it no longer appears in the Director client. The strange thing is that there are a small percentage of jobs where the instance does not get removed from Director. It has not been enough of an annoyance at this point for me to try and track down what is different about those jobs.
Mike
My current project is on 11.3 FP2 as well. Auto-purge of multi-instance jobs always clears our job log entries as expected. In the vast majority of cases, it also removes the instance so that it no longer appears in the Director client. The strange thing is that there are a small percentage of jobs where the instance does not get removed from Director. It has not been enough of an annoyance at this point for me to try and track down what is different about those jobs.
Mike