Hi All,
I have to remove the duplicates and also need to capture the duplicate records.
I thought of doing with remove duplicate stage. But it didnt worked out.
Please advise how to do it.
Thanks & Regards,
Kumar66
Remove Duplicates
Moderators: chulett, rschirm, roy
REMOVE DUPLICATES
use sort stage with the option key change column which gives the output value as '0' for non-duplicates and '1' for duplicates.And then use filter stage to filter these records separately based on the key value.
source------>sort--->filter-------->target
![Rolling Eyes :roll:](./images/smilies/icon_rolleyes.gif)
source------>sort--->filter-------->target
BugFree wrote:Do a search on "remove and capture the duplicate records" (Search for all terms). This has been answered a lot of times here.
![Rolling Eyes :roll:](./images/smilies/icon_rolleyes.gif)
![Rolling Eyes :roll:](./images/smilies/icon_rolleyes.gif)
suman