Auto deletion of temporary files from Scratch disk

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vputta
Premium Member
Premium Member
Posts: 47
Joined: Wed Oct 08, 2008 7:35 am
Location: Charlotte

Auto deletion of temporary files from Scratch disk

Post by vputta »

When ever we run a DS job which has Sort or Join stage, the scratch disk is piled up with many files like below-

-rw------- 1 dsadm dstage 10485720 Sep 21 14:33 tsortGcwTMzbR
-rw------- 1 dsadm dstage 12982320 Sep 21 14:33 tsortGcwoZGVJ
-rw------- 1 dsadm dstage 9986400 Sep 21 14:33 tsortGcwdvLFU

Do we have any option to automatically delete these temporary files from scratch disk,once the job is completed?

Thanks
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Normally those files are deleted, sometimes when jobs abort some files might remain in the scratch disks. DataStage doesn't have any builtin mechanism to delete these files; I usually go and manually delete the files in Scratch once a week or once a month, depending upon the number and the sizes.
rohitagarwal15
Participant
Posts: 102
Joined: Thu Sep 17, 2009 1:23 am

Re: Auto deletion of temporary files from Scratch disk

Post by rohitagarwal15 »

Sometime we will found such types of files present in our sratch and temporary areas for which ArndW has already stated the reason, its better if you go to these areas manually once in a week and clean all those files so that it will not occupy much more space.
Rohit
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

Sometimes we get files on our scratch disk just like Rohit said that ArndW said.

I recommend following the advice that rohit had, which was to follow the advice as ArndW stated.


:wink:
Post Reply