DSXchange

Hi,

we have a parallel job loading from one DS to Ds including look up stage.

This is the job design

Dataset
|
|
Dataset -- Lookup Stage ---Dataset
|
|
Coloumn Gen stage ----- Dataset


The job is hanged sometimes without any log and some times it is working fine.Once job is hanged we can stop the job seqn and restart it .the job is working fine.

Here source dataset data is less and reference dataset is Huge.no other jobs are running in parallel.

Can u please help me about this issue.

Thanks,
Reddy

use join stage rather than lookup stage. sure it would reslove your problem

we need a reject link.

use left outer join and get all the records to filter stage and filter out all records which has null value in any of the field which is coming form reference link (i mea right link)