Warning in Remove Duplicates Stage

srini_ramesh · Post by **srini_ramesh** » Wed Mar 09, 2005 7:32 am

Hi,
while using Remove duplicates stage I get this warning.
"Remove_Duplicates_22: When checking operator: User inserted sort "Remove_Duplicates_22.DSLink27_Sort" does not fulfill the sort requirements of the downstream operator "Remove_Duplicates_22""

Please explain how this can be resolved.

ArndW · Post by **ArndW** » Wed Mar 09, 2005 7:44 am

In order for the duplicates to be removed, you need to sort on the column(s) you are using to remove duplicate rows. Are you doing this?

T42 · Post by **T42** » Wed Mar 09, 2005 5:49 pm

You are attempting to sort on all (or less) of the keys you're trying to remove duplicate on. You need to sort on all keys, PLUS one data field.