We've been using DS now for some months and when we check the scratch-disks and the resource-disk dirs it seems that files from the first day are still there. (dirs as given in the configfile:node "node1"
{
fastname "serv"
pools ""
resource disk "dir/node01/disk00/" {pools ""}
resource scratchdisk "dir/node01/scratch00/" {pools ""}
}.
also in the projectdirs there seems to be files that are not cleaned up correctly.
Can someone give a hint about cleaning this, can we eg. clean up some dirs when we restart the processes or are there other dirs where we can clean all files older then a week,.... ?
cleaning up of diskspace
Moderators: chulett, rschirm, roy
Leave your project folders alone.
Use Administrator to handle deletion of old logs.
Data files are left behind in Scratch and resource disk spaces for certain stages (Oracle Enterprise stage comes to mind), and whenever there is a hard crash (if you kill -9 a running job for example.)
You can periodically clean out the Scratch space directory. You could put together a script and run it via CRON, looking for old untouched files.
Datasets (found on resource disk) require the use of "orchadmin delete" command on the .ds header file. This is the only safe way to maintain that directory, as there may be dataset files you want to preserve for future use/testing. You can find orchadmin on your DataStage directory (..../Ascential/DataStage/PXEngine/bin/orchadmin). Just type "orchadmin" to get the full help information.
Use Administrator to handle deletion of old logs.
Data files are left behind in Scratch and resource disk spaces for certain stages (Oracle Enterprise stage comes to mind), and whenever there is a hard crash (if you kill -9 a running job for example.)
You can periodically clean out the Scratch space directory. You could put together a script and run it via CRON, looking for old untouched files.
Datasets (found on resource disk) require the use of "orchadmin delete" command on the .ds header file. This is the only safe way to maintain that directory, as there may be dataset files you want to preserve for future use/testing. You can find orchadmin on your DataStage directory (..../Ascential/DataStage/PXEngine/bin/orchadmin). Just type "orchadmin" to get the full help information.