Job hangs at the join stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
kiranredz
Premium Member
Premium Member
Posts: 21
Joined: Wed Aug 06, 2008 8:34 am
Location: United States

Job hangs at the join stage

Post by kiranredz »

Hi, We made an upgrade to DS 8.5 by installing the datastage 8.5 fix pack 1.
Some jobs have been behaving weird. The jobs hang during execution at the join stage. And the jobs never complete.

Work around suggested by ibm was to set the Buffer settings in the Input links of join stage to Buffer (from default). Most jobs ran successfully after that. However one of them still runs forever and doesn't complete.

The job has the following stages. Dataset(1567374 rows) Join (Ref data: 2253004) Xfm and Target Dataset.

Please let me know if anyone is this forum had faced this issue or kindly post in your suggestions.
All these jobs have been working perfectly in 8.5(w/o fix pack)
Kiran
Gokul
Participant
Posts: 74
Joined: Wed Feb 23, 2005 10:58 pm
Location: Mumbai

Post by Gokul »

I had also faced same issue .

The design was
seq file ---->transformer ---> join---> dataset.
|
Seq File .

After some time of investing, we found that the data was getting leaked or truncated. A decimal (10) was mapped to decimal (6), resulting in a leak and leading to job hanging at join stage.

we corrected this and job ran fine.

I hope this helps you.
kiranredz
Premium Member
Premium Member
Posts: 21
Joined: Wed Aug 06, 2008 8:34 am
Location: United States

issue resolved with a work around

Post by kiranredz »

IBM suggested to add this environement variable - APT_NO_PART_INSERTION and set to true.
Kiran
Post Reply