Hi,
the Source data as follows:
Col1 Col2
1 aa
2 gg
1 aa
2 gg
Required output:
Col1 Col2
1 aa
2 gg
need to identify the duplicate record existance. based on the first row if any duplicates occurs the error message needs to send into error table, if the duplicate does not exist the record will load into the table. ( There is no removal of duplicates).
Thanks,
Identify the duplicates
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 35
- Joined: Mon Dec 29, 2008 2:22 am
- Location: chennai
Re: Identify the duplicates
nagarjuna900 wrote:Hi,
the Source data as follows:
Col1 Col2
1 aa
2 gg
1 aa
2 gg
Required output:
Col1 Col2
1 aa
2 gg
need to identify the duplicate record existance. based on the first row if any duplicates occurs the error message needs to send into error table, if the duplicate does not exist the record will load into the table. ( There is no removal of duplicates).
Thanks,
Use remove duplicate stage or if you are using any lookup stage after file then in partition click on perform by sort and click on unique.you will get only good records.
Thanks,
Mayrua
![Idea :idea:](./images/smilies/icon_idea.gif)
Mayura
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: