Regarding In Link sort

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
dstest
Participant
Posts: 66
Joined: Sun Aug 19, 2007 10:52 pm

Regarding In Link sort

Post by dstest »

Is in link sort use datastage scratch space or memory.

Thanks
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Memory first then, if that becomes exhausted, scratch disk. The amount of memory allocated to tsort operators is governed by an environment variable.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
dstest
Participant
Posts: 66
Joined: Sun Aug 19, 2007 10:52 pm

Post by dstest »

I have a file which contains 40million records and i need to sort the file 5 times using different keys and then take the unique record for each group.

So what is the best way to acheive this whether to use inmemory sort and take unique record or sort by using external sort stage and keed unique record.

Thanks
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

In memory. Five explict Sort stages, which allows you the ability not to sort on any already sorted/grouped key, yet to preserve that sorting order.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply