Remove duplicate and reject the duplicate records

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mayura
Participant
Posts: 40
Joined: Fri Aug 01, 2008 5:58 am
Location: Mumbai

Remove duplicate and reject the duplicate records

Post by mayura »

Source-- file having dulicate records
Target--Need only unique records

Conditon--Need to remove dulicate records and paas the unique records and reject the dulicate records into reject link.


Please help me out with this scenario.

Thx,
Mayura :lol:
Mayura
dr.murthy
Participant
Posts: 224
Joined: Sun Dec 07, 2008 8:47 am
Location: delhi

Post by dr.murthy »

Use sort stage and apply the property create cluster key col is true , then you can get the aditional fileld with 0 and 1 after that you can filter both unique and duplicate records
D.N .MURTHY
Post Reply