Auto partition in sort stage with a key

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sharmabhavesh
Premium Member
Premium Member
Posts: 38
Joined: Tue Jun 19, 2012 11:03 pm
Location: India

Auto partition in sort stage with a key

Post by sharmabhavesh »

Hi,
I am sorting some data in the sort stage and creating a key change column. My doubt is 'does Datastage partitions data as well when it has to sort data?'
I mean, if I sorted the data based on a primary key and mention the partition mode as 'auto', will Datastage automatically hash partition data as well based on the key.

Partitioning and sorting go hand in hand or they can take place exclusively.
prasson_ibm
Premium Member
Premium Member
Posts: 536
Joined: Thu Oct 11, 2007 1:48 am
Location: Bangalore

Post by prasson_ibm »

Hi,

does Datastage partitions data as well when it has to sort data?

Yes, datastage parallel sort stage implicitly places hash partition on input of the sort stage and hence auto partition will perform Hash partition.
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

It will partition the data if you have auto partition and APT_NO_PART_INSERTION environment variable is not set.
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
Post Reply