DSXchange

I have two files and I am getting few columns based on one common column.. but I want the unique records not based on the key column.

right now I am using sort stage and passing all the column name as key column in the hash partition. is this the right approach or do we have any better approach to get unique records from all the column

Is that approach working for you?

yeah it Is working. is there any other approach we can follow?

You can also use Sort stage and then Remove Duplicate stage. Leave the partitioning as Auto.