Uses of stages

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
arunkumar1111
Participant
Posts: 19
Joined: Sun Jun 29, 2008 10:19 pm

Uses of stages

Post by arunkumar1111 »

Hi

I'm using DSEE. IN this we hae many stages

We have sort stage which has remove duplicate option and in the Remove Duplicate stage we have sort option.
Which is best and when should we use each. Also we can do sort explicitily and remove duplicate then

Thanks and Regards
Arun
Thanks and Regards
Arun
Known is a drop and Unknown is an Ocean
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The same kind of sort is performed no matter how you specify it, though the Sort stage gives more control (for example over memory used) and more options (such as the ability to generate a key change column).

You can certainly use separate stages for sorting and for removing duplicates.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply