How to capture Reject data from reference dataset
Moderators: chulett, rschirm, roy
How to capture Reject data from reference dataset
Hi All,
I have a requirement to capture the reference data which is not matching with the master data set.
How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?
I have a requirement to capture the reference data which is not matching with the master data set.
How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Forget data combining stages (Lookup, Join, Merge) - they do not allow you to identify the rows that were not processed.
Look at one of the change detection stage types (Difference, Compare or, perhaps, Change Capture).
Look at one of the change detection stage types (Difference, Compare or, perhaps, Change Capture).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 251
- Joined: Mon Jun 09, 2008 5:52 am
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 26
- Joined: Sun Dec 23, 2007 3:21 am
- Location: hyderabad
Re: How to capture Reject data from reference dataset
definitely we can use the merge stage to capture the secondary(i.e ref ) dataset because when u go to join we cannot have any reject link capture and when u go for lookup it will capture the only primary unmatched data....so better to go for merge such that we can capture the secondary records into the reject link....srai wrote:Hi All,
I have a requirement to capture the reference data which is not matching with the master data set.
How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?
SRIKANTH
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Have you ever used a Merge stage, Srikanth?
What row goes into the reject link - the one from the master input or the one from the update (reference) input?
Also, please strive for a professional standard of written Engish on DSXchange. The second person personal pronoun in English is spelled "you". U is one of our posters.
What row goes into the reject link - the one from the master input or the one from the update (reference) input?
Also, please strive for a professional standard of written Engish on DSXchange. The second person personal pronoun in English is spelled "you". U is one of our posters.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 251
- Joined: Mon Jun 09, 2008 5:52 am
Re: How to capture Reject data from reference dataset
'srikanth386 wrote:definitely we can use the merge stage to capture the secondary(i.e ref ) dataset because when u go to join we cannot have any reject link capture and when u go for lookup it will capture the only primary unmatched data....so better to go for merge such that we can capture the secondary records into the reject link....srai wrote:Hi All,
I have a requirement to capture the reference data which is not matching with the master data set.
How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?
Srikanth,
I just wanted to know that can we get reject data from both master set and reference set using merge store?
Re: How to capture Reject data from reference dataset
'srikanth386 wrote:definitely we can use the merge stage to capture the secondary(i.e ref ) dataset because when u go to join we cannot have any reject link capture and when u go for lookup it will capture the only primary unmatched data....so better to go for merge such that we can capture the secondary records into the reject link....srai wrote:Hi All,
I have a requirement to capture the reference data which is not matching with the master data set.
How could we implement in DataStage using a single stage means either Transformer or Lokkup or Join or Merge?
Srikanth,
I just wanted to know that can we get reject data from both master set and reference set using merge store?
-
- Participant
- Posts: 251
- Joined: Mon Jun 09, 2008 5:52 am