Hi
Is it possible to use remove duplicates stage to extract unique records.I am requirement analysis phase.I do not have DS parallel.
ex:
Emp id
1
1
2
3
3
only 2 should go.In the manual i could find only first and last options
Thanks
Remove duplicates-Unique only
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 334
- Joined: Fri Dec 01, 2006 5:17 am
- Location: Texas
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Remove Duplicates stage will remove duplicates without needing any other stage.
You do, however, need to ensure that the data are key-partitioned and sorted on the keys being used to identify duplicates.
You do, however, need to ensure that the data are key-partitioned and sorted on the keys being used to identify duplicates.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.