Partitioning

iskapalli · Post by **iskapalli** » Wed Sep 14, 2011 1:00 am

HI,

I have used the auto partition for my job. I want to know which partition is taking for particular stage. How can I find out?

synsog · Post by **synsog** » Wed Sep 14, 2011 1:27 am

Set APT_DUMP_SCORE environment variable to TRUE and go through the score in the job log.

ray.wurlod · Post by **ray.wurlod** » Wed Sep 14, 2011 6:13 am

Learn about partitioning. Parallel stages that are not constrained to execute in a node pool will executed in every node in the default node pool. The score will show which node handles each sequential stage. Partitioning controls which rows of data go to which nodes, not the nodes on which a particular operator executes.