DSXchange

Hi All,

it is possible to remove the duplicates using sort stage in server jobs?

Thanks in Advance
Malli

No.
Not just using Sort stage, but may be using Sort coupled with Transformer and its stage variables.

mallikharjuna wrote:Hi All,

it is possible to remove the duplicates using sort stage in server jobs?

Thanks in Advance
Malli

If you can use a Hash File, then declare the primary key..and the hash file will take care of it...

But please note that for any duplicate entry, the hash file will retain the last entry in the file...

Or sort the data then use stage variables... there's a number of different ways. However, the answer to the question as asked is 'no'.

This is possible in a px sort stage with unique option selected.

Who cares?

Server question posted in the Server forum, so you got a Server answer.

Well it might be one of those days when you hear that something can be done with a particular stage. But the information was'nt comple as to on what animal. I clarified that

chulett wrote:Or sort the data then use stage variables... there's a number of different ways. However, the answer to the question as asked is 'no'.

It sounds familiar.