Resource Disk

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
danddmrs
Premium Member
Premium Member
Posts: 86
Joined: Fri Apr 20, 2007 12:55 pm

Resource Disk

Post by danddmrs »

In the Resource Disk directory there are lookuptable datasets that are several days old. I would have thought that these would get cleaned up as processes finish but apparently not or not always.

Can someone advise why some of these datasets would be left in this directory for several days and what should be done to clean these up.

Thank you.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Should mean the job aborted and thus failed to clean them up. If they are not currently in use and no longer needed, you should be able to simply delete them.

Or you may need to use to use something like "orchadmin" if they have a descriptor file as well like a normal dataset. Others will know for certain.
-craig

"You can never have too many knives" -- Logan Nine Fingers
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

If you are using any Lookup File Sets, the files they create are named in the same way, and often times those need to be saved. It's not always safe to delete such files. I discussed this with someone at IBM recently and they may enhance it in a future release so we can tell how the files were created or if they have a descriptor...
Choose a job you love, and you will never have to work a day in your life. - Confucius
danddmrs
Premium Member
Premium Member
Posts: 86
Joined: Fri Apr 20, 2007 12:55 pm

Post by danddmrs »

Thank you for the replies.

Currently these are the lookup file counts by date in the Resource Disk directory
3/19 - 253
3/18 - 251
3/17 - 251

On 3/16 the DataStage server was rebooted after Windows Updates were applied. The majority of the files are very small but there are a few larger ones as well (48,000 KB).

Deleting the files manually isn't an option for developers so we could add a process to delete files older than current day, but it seems that these files should be automatically dumped on completion of the job.
Post Reply