Clean-up or purge multi instance jobs from Director

mandyli · Post by **mandyli** » Fri Jan 25, 2013 3:22 pm

Hi

I would like to purge or clean-up from the Data stage director automatically for Multi instance jobs logs and instance also.

I hope multi-instance job will append with Invocation id.

Like:

Ld_Exe_Metric.8699687
Ld_Exe_Metric.8699688
Ld_Exe_Metric.8699689

So I don't want to keep the entire instance I need to keep just 5 days run. Is this anything I have to setup at project level?

Thanks
Man

chulett · Post by **chulett** » Fri Jan 25, 2013 4:00 pm

Well... to get this off the table right away, have you tried setting the Auto Purge option for the base job to keep 5 days worth of runs? Did that not work for you?

mandyli · Post by **mandyli** » Fri Jan 25, 2013 6:24 pm

YES.

It is working for Log. not for Job Instance.

ray.wurlod · Post by **ray.wurlod** » Fri Jan 25, 2013 7:46 pm

If you remove the instance-related records from RT_STATUSnnn then the log events for that instance will automatically be purged.

mandyli · Post by **mandyli** » Fri Jan 25, 2013 8:18 pm

Thanks Ray.

Is this any way I can do it automatically ?

Like Auto-purge

Thanks
Man

chulett · Post by **chulett** » Sat Jan 26, 2013 12:10 am

OK... it's been awhile but since there is only one log that all instances share and I thought I recalled that the Director uses what is basically a view into that log to show what happened for each instance run, I thought I remembered that purging the instance specific records from the log would remove the display of those runs from the Director as well.

Based on Ray's reply, that would seem to be not the case. So, are you (either of you) saying that it will still show the instance in the Director log but have nothing to display when you check the log for that instance? I would think by now 'they' would have implemented something more... generic... than having to go under the covers and remove 'instance-related records' from a hashed file.

I'm assuming the old 'trick' of recompiling (resetting?) the job still removes all instances from the Director? I realize that wasn't what was asked for, just seeking a clarification...

ray.wurlod · Post by **ray.wurlod** » Sat Jan 26, 2013 12:16 am

There's no automatic way, but you could create a server routine and run it from the Routine editor's Test button.

mandyli · Post by **mandyli** » Thu Mar 14, 2013 6:24 pm

Thanks Ray.

I can able to see the Auto-purge is working for only Jobs not for multi instance jobs.

I hope I have to clear the RT_STATUS for all the multi instance jobs.

I see the following information from IBM.

"The RT_STATUS part of the log auto-purge can be disabled by setting an
environment variable DS_NO_INSTANCE_PURGING=1 "

Is this will helpful or will do for multi instance jobs from Director?

Thanks
Man

ray.wurlod · Post by **ray.wurlod** » Thu Mar 14, 2013 7:18 pm

I'm not sure what that statement from IBM Is about. Can you please cite a source? Meanwhile, you do not have to clear the RT_STATUS file (that would be unwise); you only need to delete the entries corresponding to the invocation ID(s) that you want to purge.

mandyli · Post by **mandyli** » Fri Mar 15, 2013 11:25 am

Thanks Ray.

I want to delete the multi instance file from Director.

Thanks
Man

ray.wurlod · Post by **ray.wurlod** » Fri Mar 15, 2013 3:35 pm

I don't know that you can. What happens if you try?

mandyli · Post by **mandyli** » Fri Mar 15, 2013 7:55 pm

If I try to delete from director it will delete,but I need to delete automatically.

Thanks
Man

nirav.parikh · Post by **nirav.parikh** » Mon Aug 26, 2013 4:02 pm

This is a bug for which there is a patch out there.

Even when you have the auto-purge setting set at say last 5 runs, the logs related to different instances do not go away.

Please install Patch JR46141 and this issue should go away.

http://www-01.ibm.com/support/docview.w ... wg1JR46141

We have got this installed in our environements and it worked like a charm.