Parallel job Hanged

reddy82 · Post by **reddy82** » Mon May 23, 2011 4:15 am

Hi,

we have a parallel job loading from one DS to Ds including look up stage.

This is the job design

Dataset
|
|
Dataset -- Lookup Stage ---Dataset
|
|
Coloumn Gen stage ----- Dataset

The job is hanged sometimes without any log and some times it is working fine.Once job is hanged we can stop the job seqn and restart it .the job is working fine.

Here source dataset data is less and reference dataset is Huge.no other jobs are running in parallel.

Can u please help me about this issue.

Thanks,
Reddy

singhald · Post by **singhald** » Mon May 23, 2011 5:08 am

use join stage rather than lookup stage. sure it would reslove your problem

reddy82 · Post by **reddy82** » Mon May 23, 2011 5:19 am

we need a reject link.

singhald · Post by **singhald** » Mon May 23, 2011 5:29 am

use left outer join and get all the records to filter stage and filter out all records which has null value in any of the field which is coming form reference link (i mea right link)