Page 1 of 1

How to capture Reject data from reference dataset

Posted: Fri Jan 08, 2010 8:32 am
by srai
Hi All,

I have a requirement to capture the reference data which is not matching with the master data set.

How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?

Posted: Fri Jan 08, 2010 9:17 am
by grimm336
For this join can be the best option.
beacause in look up you can only get records of master dataset,

Posted: Fri Jan 08, 2010 5:00 pm
by ray.wurlod
Forget data combining stages (Lookup, Join, Merge) - they do not allow you to identify the rows that were not processed.

Look at one of the change detection stage types (Difference, Compare or, perhaps, Change Capture).

Posted: Mon Jan 11, 2010 12:50 am
by srinivas.g
you can use merge stage.
it will cpature reference dataset reject records.

Posted: Mon Jan 11, 2010 2:22 am
by ray.wurlod
But it won't
srai wrote:capture the reference data which is not matching with the master data set

Re: How to capture Reject data from reference dataset

Posted: Mon Jan 11, 2010 3:38 am
by srikanth386
srai wrote:Hi All,

I have a requirement to capture the reference data which is not matching with the master data set.

How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?
definitely we can use the merge stage to capture the secondary(i.e ref ) dataset because when u go to join we cannot have any reject link capture and when u go for lookup it will capture the only primary unmatched data....so better to go for merge such that we can capture the secondary records into the reject link....

Posted: Mon Jan 11, 2010 3:43 am
by ray.wurlod
Have you ever used a Merge stage, Srikanth?

What row goes into the reject link - the one from the master input or the one from the update (reference) input?

Also, please strive for a professional standard of written Engish on DSXchange. The second person personal pronoun in English is spelled "you". U is one of our posters.

Posted: Mon Jan 11, 2010 3:52 am
by srinivas.g
update(reference) input link reject rows

Re: How to capture Reject data from reference dataset

Posted: Mon Jan 11, 2010 6:17 am
by srai
srikanth386 wrote:
srai wrote:Hi All,

I have a requirement to capture the reference data which is not matching with the master data set.

How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?
definitely we can use the merge stage to capture the secondary(i.e ref ) dataset because when u go to join we cannot have any reject link capture and when u go for lookup it will capture the only primary unmatched data....so better to go for merge such that we can capture the secondary records into the reject link....
'

Srikanth,
I just wanted to know that can we get reject data from both master set and reference set using merge store?

Re: How to capture Reject data from reference dataset

Posted: Mon Jan 11, 2010 6:20 am
by srai
srikanth386 wrote:
srai wrote:Hi All,

I have a requirement to capture the reference data which is not matching with the master data set.

How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?
definitely we can use the merge stage to capture the secondary(i.e ref ) dataset because when u go to join we cannot have any reject link capture and when u go for lookup it will capture the only primary unmatched data....so better to go for merge such that we can capture the secondary records into the reject link....
'

Srikanth,
I just wanted to know that can we get reject data from both master set and reference set using merge store?

Posted: Mon Jan 11, 2010 8:04 am
by srinivas.g
Yes....(Merge stage)

Master reject rows will stored in stream output link and
Reference reject rows will be stored in reject link.