LeftOuter Join Vs Lookup Stage with Continue Option

[Developer9]

Hi All,

As part of my testing for the jobs ,I realized that there is some difference in my output record counts when I Join two input data streams

Code: Select all

1.LeftOuter Join ---53000 out put count

2.Lookup Stage (Condition for failure -Continue)-150000 output count

I am in the process of figuring out why there is a mismatch of record counts ..I know it should match in both jobs or is a valid in some scenarios ?

Let me know any suggestion for my testing or in which scenario this can happen

Thank you

[ray.wurlod]

Check which inputs are Left and Right in your Join stage.

The stream that is Left should be the stream that is the stream input for the Lookup stage.

Keep in mind also the partitioning and sorting requirements for the Join stage, and the partitioning requirements for the Lookup stage.