Page 1 of 1
Partitioning
Posted: Wed Sep 14, 2011 1:00 am
by iskapalli
HI,
I have used the auto partition for my job. I want to know which partition is taking for particular stage. How can I find out?
Partitioning
Posted: Wed Sep 14, 2011 1:27 am
by synsog
Set APT_DUMP_SCORE environment variable to TRUE and go through the score in the job log.
Posted: Wed Sep 14, 2011 6:13 am
by ray.wurlod
Learn about partitioning. Parallel stages that are not constrained to execute in a node pool will executed in every node in the default node pool. The score will show which node handles each sequential stage. Partitioning controls which rows of data go to which nodes, not the nodes on which a particular operator executes.