Capturing duplicate records using sort stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
phanikumar
Participant
Posts: 60
Joined: Tue Sep 20, 2011 10:44 pm
Location: INDIA

Capturing duplicate records using sort stage

Post by phanikumar »

Hi,

I need to capture duplicate records along with the master record using sort stage. Can somebody explain how to achieve this.

I tried to perform this by creating the key change column set to TRUE and I tried to filter on Key change column =0 which eliminates master record.

Any tips to achieve this ?


Regards
Kumar
thirupathireddy.gankidi
Participant
Posts: 19
Joined: Mon Aug 08, 2011 3:20 am

Re: Capturing duplicate records using sort stage

Post by thirupathireddy.gankidi »

Write two filter conditions

1)filter on Key change column =0 which gives duplicate records.
2)filter on Key change column =1 which gives unique records.
Post Reply