DSXchange

Hi Team,

From that last 2 days all the Datastage jobs are running slow in our server.
Even extraction from sequential files seems to be slow.

We have around 60 GB Free space in the Drive where DS is installed. All Hashfiles and output files are kept in separate Drive which has around 200 GB Free space.

We are trying to clear the job logs using Director. Is there any way to clear all logs ?

What all other steps we should perform to make the jobs run faster

Regards
Sree

Can I delete the RT_Log files from the project directory ?

What are RT_Status and RT_BP Files ?

Do not delete RT_BPnnn or any file as such from there, RT_LOG* or RT_STATUS* can be cleared but for that use CLEAR.FILE <file name> instead from dssh/uvsh or from command window of administrator client.

Also have a peek into the &PH& directory to ensure that the number of files isn't too much. You decide how much is too much.

Hi,

Thanks for input. Is there any way to clear multiple log files using the Clear.File command ?

No. And it's CLEAR.FILE as in all CAPS as was posted.

sreesuku2 wrote:Can I delete the RT_Log files from the project directory ?

Also wanted to emphasis the previous answer: NO. What makes you think they are the problem? Are they 'large' and if so, do you not have auto-purge enabled for your job logs? This also assumes that you have your logging going to the Universe repository rather than XMETA, any idea what your LOGGING settings are?

Hi,

I don't have the auto purging enabled. One project have the log size close to 20 GB (Thats the maximum size).
Where can I see my LOGGING settings ?

Enable auto purge in the Director. Now. Also found a decent discussion that should help here.

Hi,

I have read somewhere Auto Purging is only possible for the the jobs which are getting created newly. Is it possible to do Auto-purge for existing jobs ?

mass recompile would do the trick.

sreesuku2 wrote:Is it possible to do Auto-purge for existing jobs ?

Of course. What you read was than in older versions Auto Purge settings / changes would only be automatically applied to new jobs. You can always enable it one by one for any job you desire. Newer versions will propagate Auto Purge settings to all jobs, something easy enough to test to see for yourself. What version are you running?

I am on V 8.5

I'm fairly certain that version will take your project level Auto Purge settings and propagate them down to all jobs automagically. Give it a try, let us know!

Just remember that the auto purge only happens when you actually update a job log entry.

Right - it will start purging them the next time it runs, assuming the job does not fail. Oh, and by 'let us know' I meant check a job via the Director to see what the current Auto Purge settings are that it has, no need to run the job just to check that.