Page 1 of 1
Clearing the temporary files in Datastage
Posted: Mon Dec 13, 2004 3:23 pm
by arun_im4u
Hi,
When I run a job which has a hashed file stage or a sorter stage it creates a lot of temporary files under the datastage home directory. How do i clear them. It takes up a lot of my disk space. Can i delete these files from the client side???
ThankYou.
delete temp file
Posted: Mon Dec 13, 2004 9:03 pm
by changming
in transformer, after stage rountine, excute sh script,
rm file_path/file_name
Posted: Mon Dec 13, 2004 10:20 pm
by chulett
Well...
The Sort stage by default puts the temporary files it uses in the current Project, which is not the best place for them. Jobs that generate a large volume of temp files can fill your Project partition and then you'll find yourself in all kinds of hurt.
On the General / Properties tab of the stage there is a
Temporary Directory option. Change it to something appropriate to your system like
/tmp and it will put all of its files there. Normally the stage cleans up after itself, but when it doesn't it is best to have the leftovers off in someplace like /tmp.
As to the Hash files, they too by default go into your Project, but
do not make use of any temporary files. The files you are seeing
are (more than likely) the hash files themselves, so I'd be a little careful about just going out and deleting things.
BTW, all of the temporary sort files start with 'soa', from what I recall. Those would be safe to delete if the job that generated them is not running.