Remove duplicate with certain type

Oritech · Post by **Oritech** » Wed Sep 15, 2010 10:28 pm

I want to remove duplicate ID with type 2,as per below senario

Input

id type
1 1
2 2
3 3
3 2 -> To be removed for duplicate Id = 3
4 3
4 2 -> To be removed for duplicate Id = 4
5 5

output

id type
1 1
2 2
3 3
4 3
5 5

Shall apprciate your help in putting this logic in datastage.

behrouz · Post by **behrouz** » Wed Sep 15, 2010 11:12 pm

dont have you to find the duplicate first then filter by type

Regards
Arash.

ray.wurlod · Post by **ray.wurlod** » Thu Sep 16, 2010 12:13 am

Remove Duplicates stage keyed on "id" retaining the First record from each group.