Page 1 of 1

Problem with long running DataStage job

Posted: Wed Apr 11, 2007 10:34 pm
by yaminids
Hello friends,

I have a shellscript which triggers DataStage job multiple times in a loop. In short, at the beginning the shellscript executes a PL/SQL procedure which generates some files. Then it triggers the DataStage sequence which in turn triggers the job to process the files. This process continues multiple times until the conditon of the loop is false (atleast 10 times per execution)

The problem is sometimes the status of the DataStage job shows 'Running' in Director even though the job is done (in Designer all the links turn Green). As a result the shellscript loop cannot trigger the job next time and the whole process freezes

I found the following sessions on the server the job froze last time.

dstage 26116 24880 99 21:34 ? 01:34:06 phantom DSD.RUN CNMR_RPT_001. 0/1/1/0/0
dstage 26129 26116 0 21:34 ? 00:00:00 [uvsh <defunct>]
dstage 26131 26116 0 21:34 ? 00:00:00 [uvsh <defunct>]
dstage 26463 26116 0 21:34 ? 00:00:00 [uvsh <defunct>]
dstage 26494 26116 0 21:34 ? 00:00:00 [uvsh <defunct>]
dstage 26497 26116 0 21:34 ? 00:00:00 [uvsh <defunct>]
dstage 26509 26116 0 21:34 ? 00:00:00 [uvsh <defunct>]


Can someone please help me in debugging the issue

Thanks a lot in advance
Yamini

Posted: Thu Apr 12, 2007 2:09 am
by ray.wurlod
Make sure that the deadlock daemon (uvdlockd) is running.

Make sure that the job finishes reliably - even an after-job subroutine that performs a small innocuous task.

Posted: Thu Apr 12, 2007 8:12 am
by yaminids
Ray,

Thanks a lot for your response.
One more follow-up question. How can I check that'deadlock daemon' is running?

Thanks
Yamini

Posted: Thu Apr 12, 2007 9:30 am
by Vikas Jain
I guess, U can chk dat in Administrator--> Env. variables

Posted: Thu Apr 12, 2007 2:20 pm
by yaminids
I dont think that the parameter can be set in Administrator. If I remember correctly, the parameter can be set in a file on the Linux server where the software is installed

Yamini

Posted: Thu Apr 12, 2007 3:05 pm
by ray.wurlod
The deadlock daemon is not governed by any environment variable.

Its auto-start is configured in a file called dsdlockd.config in the DataStage engine directory.

You can check to see whether it's running by looking for its process using UNIX commands.

Code: Select all

ps -ef | grep dsdlockd | grep -v grep

Posted: Fri Apr 13, 2007 3:08 pm
by yaminids
Thanks Ray