Job running forever....

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
madhukar
Participant
Posts: 86
Joined: Fri May 20, 2005 4:05 pm

Job running forever....

Post by madhukar »

in one of the run, a job stayed in running mode for ever and eventually it had to be killed.

series of activities happened:
Job sequences triggered through control-m.
first job sequence completed successfully, second sequence started
the first job in the second sequence stayed in running mode forever
the job even didn't start reading the file. the job log produced only :

Starting Job <jobname>.
pxPRSLoadWrkrPvt02..BeforeJob (ExecSH): Executed command: touch <filename> *** No output from command ***
Environment variable settings:
Parallel job initiated
Parallel job default NLS map ISO-8859-1, default locale OFF
Advanced runtime options used: -default_date_format "%yyyy-%mm-%dd"

In this case, how to go about debugging without aborting the job?

PS: job ran successfully when it was killed and ran again.
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

How often does this happen? Are you purging your log files regularly. Also keep the &PH& folder size in check?
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
madhukar
Participant
Posts: 86
Joined: Fri May 20, 2005 4:05 pm

Post by madhukar »

this happened for first time.
auto purge of log has been set for one day.
madhukar
Participant
Posts: 86
Joined: Fri May 20, 2005 4:05 pm

Post by madhukar »

problem is recurring now...
can somebody help in this regard??
nick.bond
Charter Member
Charter Member
Posts: 230
Joined: Thu Jan 15, 2004 12:00 pm
Location: London

Post by nick.bond »

Can you see a process for the job running? You need to work out if the job is actually running, i.e. has a process or whether the process has died and it is a problem with the way director is reporting the status of the job.
Regards,

Nick.
madhukar
Participant
Posts: 86
Joined: Fri May 20, 2005 4:05 pm

Post by madhukar »

if i see the process in Unix, the job's process is in in SLEEP state with last column (COMMAND) as phantom...
i used unix top command.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

So... in other words, there's no problem? Phantom just means DataStage background process, which all jobs run as and SLEEP just means it's very tired. :wink:

Just how busy is your server? What exactly is your job doing? Could there be other resource issues that are causing the job to stall - database, perhaps?
-craig

"You can never have too many knives" -- Logan Nine Fingers
nick.bond
Charter Member
Charter Member
Posts: 230
Joined: Thu Jan 15, 2004 12:00 pm
Location: London

Post by nick.bond »

Can yoy povide a description of what you job consists of? Which stages? Files? Databases? Before job routines?
Regards,

Nick.
madhukar
Participant
Posts: 86
Joined: Fri May 20, 2005 4:05 pm

Post by madhukar »

after a lot of research what we found is

if the job is compiled by other than the user, used to start it, job hangs.
now after compiling the jobs with user used to start it, jobs are running fine.

Any thoughts on this?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Permissions in the project directory and/or umask settings for the users are inappropriate.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I guess I haven't really seen this because, outside of the Dev environment anyway, a single functional id is used to compile and run all jobs. Always done it that way.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply