want to pass unique and dup record seperately

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
deesh
Participant
Posts: 193
Joined: Mon Oct 08, 2007 2:57 am

want to pass unique and dup record seperately

Post by deesh »

Hi,

Any one can suggest me
how to pass single input file unique and duplicate records seperately in different outputs without usage of transformer stage.
Last edited by deesh on Tue Jun 14, 2011 10:45 am, edited 1 time in total.
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Look into sort stage and filter stage.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Use a fork join design and a downstream filter on the count. The solution has been posted previously on DSXchange.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
deesh
Participant
Posts: 193
Joined: Mon Oct 08, 2007 2:57 am

Re: want to pass unique and dup record seperately

Post by deesh »

Hi All,
Problem was solved. see the below process.

source file---> select option in Sort stage (Create Key change column (True)), it produce unique records in "1", dup records in "0",----> Filter stage take two output links one for dup, second for unique records filter based on create key column basis.

If any one not understand, let reply to me i will give more informaion.
Post Reply