it is possible to remove the duplicares using sort stage?

[mallikharjuna]

Hi All,

it is possible to remove the duplicates using sort stage in server jobs?

Thanks in Advance
Malli

[kumar_s]

No.
Not just using Sort stage, but may be using Sort coupled with Transformer and its stage variables.

[parag.s.27]

Hi All,

it is possible to remove the duplicates using sort stage in server jobs?

Thanks in Advance
Malli

If you can use a Hash File, then declare the primary key..and the hash file will take care of it...

But please note that for any duplicate entry, the hash file will retain the last entry in the file...

[chulett]

Or sort the data then use stage variables... there's a number of different ways. However, the answer to the question as asked is 'no'.

[DSguru2B]

This is possible in a px sort stage with unique option selected.

[chulett]

Who cares?

Server question posted in the Server forum, so you got a Server answer.

[DSguru2B]

Well it might be one of those days when you hear that something can be done with a particular stage. But the information was'nt comple as to on what animal. I clarified that

[kumar_s]

Or sort the data then use stage variables... there's a number of different ways. However, the answer to the question as asked is 'no'.

It sounds familiar.