How to find a huge job log

mchaves · Post by **mchaves** » Mon Sep 12, 2005 6:12 pm

Hi,

I need to find a huge log generated by job within 1000 jobs in order to delete it. How can I do that quickly?

Thanks

singhald · Post by **singhald** » Mon Sep 12, 2005 6:16 pm

hi
Go to the Datastage director and click view it will dropdown menu click show all it will show the entire log generated by job ,

so u can easily delete the log

deepak singhal

mchaves · Post by **mchaves** » Mon Sep 12, 2005 7:15 pm

Hi Deepak,

The problem is that we don't which jobs have generated such huge logs. I would to have a script the pulls the jobs and how much log data each job has.

Thanks,
Melquior

ray.wurlod · Post by **ray.wurlod** » Mon Sep 12, 2005 8:04 pm

Every job log is a separate table. You can't easily do it with SQL. Create yourself a Routine to do it. Loop through all the job names and find the corresponding job number from DS_JOBS, then count the records in RT_LOGnnn where nnn is the job number. Generate your report as you go.

kduke · Post by **kduke** » Mon Sep 12, 2005 8:53 pm

If you are in Windows then good luck but UNIX:

Code: Select all

#!/bin/ksh
# 500mb
find . -size +500000000c -exec ls -l {} \;

chulett · Post by **chulett** » Mon Sep 12, 2005 9:42 pm

In other words, to do this from the operating system you need to examine all of the RT_LOGnnn directories in the Project directory where this happened, looking for the 'Big Ones'. A query against DS_JOBS will translate the job number into a job name.

manojmathai · Post by **manojmathai** » Tue Sep 13, 2005 5:33 am

Hi

Find the log file that has the maximum size in the projects directory.
It will start with name as RT_LOG(I think)
Open the file to see the first line in the file.
The jobname will be in there in that line.

Thanks and Regards
Manoj

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Tue Sep 13, 2005 7:23 am

I wonder how the post from chullet appeared before manojmathai even though it was posted much after that !!

chulett · Post by **chulett** » Tue Sep 13, 2005 7:28 am

Two different days, Sai.

ray.wurlod · Post by **ray.wurlod** » Tue Sep 13, 2005 4:31 pm

Same day where I am, but Craig's is about eight hours ahead of Manoj's.

chulett · Post by **chulett** » Tue Sep 13, 2005 4:32 pm

Actually, Dennis lets me take cuts.

kduke · Post by **kduke** » Tue Sep 13, 2005 6:34 pm

Thanks.

ray.wurlod · Post by **ray.wurlod** » Tue Sep 13, 2005 8:03 pm

When I did the training for version 1.0 (which was VERY slow), the instructor set us a task for a prize; the winner had to create the job that finished in the least possible time, as measured in Director.

My job finished in half the time of everyone else's. 7 minutes against their 15 and more.

I got disqualified when they found I'd changed the system clock on the server after the job had started.

kduke · Post by **kduke** » Tue Sep 13, 2005 8:19 pm

Ray

I lost some respect for you.

chulett · Post by **chulett** » Tue Sep 13, 2005 9:38 pm

Ah... Ray's own Kobayashi Maru.