How to capture Reject data from reference dataset

[srai]

Hi All,

I have a requirement to capture the reference data which is not matching with the master data set.

How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?

[grimm336]

For this join can be the best option.
beacause in look up you can only get records of master dataset,

[ray.wurlod]

Forget data combining stages (Lookup, Join, Merge) - they do not allow you to identify the rows that were not processed.

Look at one of the change detection stage types (Difference, Compare or, perhaps, Change Capture).

[srinivas.g]

you can use merge stage.
it will cpature reference dataset reject records.

[ray.wurlod]

But it won't

capture the reference data which is not matching with the master data set

[srikanth386]

Hi All,

I have a requirement to capture the reference data which is not matching with the master data set.

How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?

definitely we can use the merge stage to capture the secondary(i.e ref ) dataset because when u go to join we cannot have any reject link capture and when u go for lookup it will capture the only primary unmatched data....so better to go for merge such that we can capture the secondary records into the reject link....

[ray.wurlod]

Have you ever used a Merge stage, Srikanth?

What row goes into the reject link - the one from the master input or the one from the update (reference) input?

Also, please strive for a professional standard of written Engish on DSXchange. The second person personal pronoun in English is spelled "you". U is one of our posters.

[srinivas.g]

update(reference) input link reject rows

[srai]

Hi All,

I have a requirement to capture the reference data which is not matching with the master data set.

How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?

definitely we can use the merge stage to capture the secondary(i.e ref ) dataset because when u go to join we cannot have any reject link capture and when u go for lookup it will capture the only primary unmatched data....so better to go for merge such that we can capture the secondary records into the reject link....

'

Srikanth,
I just wanted to know that can we get reject data from both master set and reference set using merge store?

[srai]

Hi All,

I have a requirement to capture the reference data which is not matching with the master data set.

How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?

definitely we can use the merge stage to capture the secondary(i.e ref ) dataset because when u go to join we cannot have any reject link capture and when u go for lookup it will capture the only primary unmatched data....so better to go for merge such that we can capture the secondary records into the reject link....

'

Srikanth,
I just wanted to know that can we get reject data from both master set and reference set using merge store?

[srinivas.g]

Yes....(Merge stage)

Master reject rows will stored in stream output link and
Reference reject rows will be stored in reject link.