Page 1 of 1

identify temp files created by DS

Posted: Thu Apr 27, 2006 11:37 pm
by novice_pgr
Our AIX is running out of space , but very recently we added 1GB for this /dstage/dsadm folder.
When we increased the space , DataStage was running quite faster.

How do i identify the temporary files which i can delete in DataStage to clear off some space.
I have already cleared of some unnecessary projects in it.

Any solutions ?

/dev/lv03 13631488 485992 97% 26858 2% /dstage/dsadm

Posted: Fri Apr 28, 2006 12:47 am
by ray.wurlod
In the uvconfig file there is a directory whose pathname is recorded as UVTEMP. You can remove any files from here that are owned by a DataStage process, provided the DataStage process is no longer running.

You can purge most entries from &PH& in each project, particularly the older ones. If there are old entries in &SAVEDLISTS& in each project, you can consider removing those also.

That's about it. The server engine tends to keep all its temporary files in the UVTEMP directory. It *should* clean these up but, if a job aborts, its cleanup mechanism never gets invoked.

Posted: Wed May 03, 2006 10:59 am
by mauherga
Hi,

try to delete all files in your &PH& proyects file, there are a files that DS use when the jobs run and there are not necesary.

/proyectdir/&PH&/

Posted: Wed May 03, 2006 12:21 pm
by DSguru2B
Clear the entries for RT_LOGnnn files by the
CLEAR.FILE command.
Where nnn is the job number.

Posted: Wed May 03, 2006 12:22 pm
by DSguru2B
And also have your jobs set to auto purge.
I had also faced a similar problem a few weeks back and the above method was adapted to increase the size.

Posted: Wed May 03, 2006 8:55 pm
by ray.wurlod
The directory pointed to by UVTEMP may contain any of the following.


- temporary files when compiling sica constraints ('compconXXXX') as part of DataStage SQL security

- temporary files used for sorting (partitions files that are then merged) 'sort'XXX')

- temporary files for EXECUTE...CAPTURING ('captureXXX') including ExecSH, ExecDOS, ExecTCL, DSExecute()

- temporary files for UniVerse SQL SELECT statements ('selectXXXX')

- temporary files for BASIC compiler ('bascXXX')

- temporary files used by hash.help ('hhelpXXX')

- temporary files used by hash.test ('htestXXX')

- temporary files used by init.catalog ('uvXXXX') for example when clearing the BASIC Catalog from shared memory

- temporary files used for Btree navigation ('btreeXXX') to resolve a location in a secondary index

- temporary files used by sorter to communicate to it ('selectXXXnotify')

- temporary files used by SDML (SQL) queries ('sdmlXXX')

- temporary files when using DATA statements ('DATAXXX' ) in BASIC programs and/or in paragraphs

- temporary files used by 'verify' function ("verifyXXX") in particular the VERIFY.SQL command

- temporary files used by MASTER command ('masterXX')


These *should* be cleaned up automatically, but may not be if a task aborts.
Periodically, therefore, delete old entries from the UVTEMP directory.

Posted: Fri May 04, 2007 12:37 pm
by mystuff
uvconfig file
Where does the uvconfig file reside & does it suffice to select autopurge on Datastage Administrator or do we need to set it somewhere else as well?

Posted: Fri May 04, 2007 1:03 pm
by DSguru2B
Just in the Administrator. But it will not effect the pre-existing jobs. Ken has a utility that purges logs as well as sets the purge limit. Search for it here.