Functionality of Preserve Partition
Posted: Tue Mar 04, 2014 2:58 am
Functionality of Preserve Partition 'SET' is equivalent to explicitly specifying SAME partitioning or not?.
If we put Preserve Partition as 'SET' in any stage example (Transformer, Join stage ), the downstream/subsequent stages will use the same partition of upstream or I can choose my partition on one stage and using SAME partition in the downstream stages.
What exactly would be the difference and which Scenario 'SET' is advantageous over SAME. Which one is advisable using a preserve partition flag in the upstream or Same partition in downstream. Any specific scenario where Preserve partition is advantageous over Same? If both are same, What is the reason for IBM to create SET and SAME.
If we put Preserve Partition as 'SET' in any stage example (Transformer, Join stage ), the downstream/subsequent stages will use the same partition of upstream or I can choose my partition on one stage and using SAME partition in the downstream stages.
What exactly would be the difference and which Scenario 'SET' is advantageous over SAME. Which one is advisable using a preserve partition flag in the upstream or Same partition in downstream. Any specific scenario where Preserve partition is advantageous over Same? If both are same, What is the reason for IBM to create SET and SAME.