Page 1 of 1

Parallel Jobs hanging in DataStage

Posted: Mon Jul 27, 2009 6:05 am
by arvind_ds
I am running a job sequence containing 7 parallel jobs. All the 7 jobs are running in parallel. Each job has below design.

Sequence File ---> Transformer ---> DB2 Table(DB2 EE Stage, Load and truncate method)

Sometimes all the individual jobs are in hanged state. The datastage director shows all the jobs in running state but no data is actually getting inserted into underlying table. Then I use to stop all 7 parallel jobs and clear the underlying table from load pending state and re-start the main job sequence.

After doing this, the job sequence runs fine. Need to know why the jobs are getting hanged.

I checked the network traffic, Memory, CPU Utilization, table space etc...Everything is fine.

Don't know why this thing is happening. These jobs are in production and I have executed them more than 100 times so far without any trouble.

Any idea.?

Posted: Mon Jul 27, 2009 6:08 am
by Sainath.Srinivasan
Are there any ds phantoms or osh running ?

Posted: Mon Jul 27, 2009 6:10 am
by arvind_ds
No

Posted: Mon Jul 27, 2009 6:23 am
by chulett
You say 'underlying table' singular - are all seven jobs writing to the same table? If not, I would think getting your DBA involved to monitor things when they are 'hung' would be the next logical step.

Posted: Mon Jul 27, 2009 6:43 am
by arvind_ds
All 7 jobs are writing to 7 different tables. Cross checked with the DBA, but no activity is going on these 7 tables when the jobs appear in hanged state.

Posted: Mon Jul 27, 2009 7:23 am
by ArndW
Try identifying one process and doing a "truss" on it to see which (if any) system calls are being generated.

Posted: Mon Jul 27, 2009 12:18 pm
by gpatton
You mention that these jobs are running in production fine. I am assuming that your problem is in other environment. Are the database tablespaces the same in that environment as they are in prod? When DB2 executes load it does some locking at tablespace level.