DSXchange

Posted: **Mon Sep 12, 2005 6:12 pm**

Hi,

I need to find a huge log generated by job within 1000 jobs in order to delete it. How can I do that quickly?

Thanks

Posted: **Mon Sep 12, 2005 6:16 pm**

hi
Go to the Datastage director and click view it will dropdown menu click show all it will show the entire log generated by job ,

so u can easily delete the log

deepak singhal

Posted: **Mon Sep 12, 2005 7:15 pm**

Hi Deepak,

The problem is that we don't which jobs have generated such huge logs. I would to have a script the pulls the jobs and how much log data each job has.

Thanks,
Melquior

Posted: **Mon Sep 12, 2005 8:04 pm**

Every job log is a separate table. You can't easily do it with SQL. Create yourself a Routine to do it. Loop through all the job names and find the corresponding job number from DS_JOBS, then count the records in RT_LOGnnn where nnn is the job number. Generate your report as you go.

Posted: **Mon Sep 12, 2005 8:53 pm**

If you are in Windows then good luck but UNIX:

Code: Select all

#!/bin/ksh
# 500mb
find . -size +500000000c -exec ls -l {} \;

Posted: **Mon Sep 12, 2005 9:42 pm**

In other words, to do this from the operating system you need to examine all of the RT_LOGnnn directories in the Project directory where this happened, looking for the 'Big Ones'. A query against DS_JOBS will translate the job number into a job name.

Posted: **Tue Sep 13, 2005 5:33 am**

Hi

Find the log file that has the maximum size in the projects directory.
It will start with name as RT_LOG(I think)
Open the file to see the first line in the file.
The jobname will be in there in that line.

Thanks and Regards
Manoj

Posted: **Tue Sep 13, 2005 7:23 am**

I wonder how the post from chullet appeared before manojmathai even though it was posted much after that !!

Posted: **Tue Sep 13, 2005 7:28 am**

Two different days, Sai.

Posted: **Tue Sep 13, 2005 4:31 pm**

Same day where I am, but Craig's is about eight hours ahead of Manoj's.

Posted: **Tue Sep 13, 2005 4:32 pm**

Actually, Dennis lets me take cuts.

Posted: **Tue Sep 13, 2005 6:34 pm**

Thanks.

Posted: **Tue Sep 13, 2005 8:03 pm**

When I did the training for version 1.0 (which was VERY slow), the instructor set us a task for a prize; the winner had to create the job that finished in the least possible time, as measured in Director.

My job finished in half the time of everyone else's. 7 minutes against their 15 and more.

I got disqualified when they found I'd changed the system clock on the server after the job had started.

Posted: **Tue Sep 13, 2005 8:19 pm**

Ray

I lost some respect for you.

Posted: **Tue Sep 13, 2005 9:38 pm**

Ah... Ray's own Kobayashi Maru.

DSXchange

How to find a huge job log

How to find a huge job log