Page 1 of 1

Sorting, Partitoning

Posted: Mon Mar 10, 2008 11:51 am
by just4u_sharath
If the job is flowing with hash partition, and in between if i insert a sort, will the hash partition will flow to the output stage of sort.
Does the sort stage retains the partition done before. Or else i have to partition again after a sort stage.

Posted: Mon Mar 10, 2008 12:07 pm
by ArndW
Your sort stage lets you choose how to handle partitioning - by default it will not repartition so you don't need to repartition after the sort.

Posted: Wed Mar 12, 2008 12:54 am
by Raghavendra
I will prefer to set the partition to same in the sort stage for this scenario.

Posted: Wed Mar 12, 2008 12:56 am
by Nripendra Chand
same partitioning should be used if hash keys and sort keys are same.