Type of partitioning
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 89
- Joined: Sat Jul 24, 2010 11:33 pm
Type of partitioning
Hi Can any1 explain me what type of partitioning should be used on the stages. Iam new to this and i dnt know which partitioning like same or hash or entire or auto ??
-
- Premium Member
- Posts: 892
- Joined: Thu Oct 16, 2003 5:18 am
Like Srinivasalu pointed Hash partitioning is key based partitioning.
Now in order for you to give better explanation (I suppose this is an interview question)
Hash partitioning is used in stages like Aggregator, Remove Duplicate or any of the stages where similar records needs to be in the same partition.
Its mainly this Hash partitioning which plays an important role. Also, although it says that "Entire" partitioning should be used in lookups it is better to use Hash partitioning in lookup because it serves the purpose and more importantly Entire partitioning can be a major performance issue if the data in the reference table is too large.
And of-course the default partitioning method is Auto.
Hope this helped but if you just understand the concept of each partitioning method then it becomes a lot easier for you to explain.
Now in order for you to give better explanation (I suppose this is an interview question)
Hash partitioning is used in stages like Aggregator, Remove Duplicate or any of the stages where similar records needs to be in the same partition.
Its mainly this Hash partitioning which plays an important role. Also, although it says that "Entire" partitioning should be used in lookups it is better to use Hash partitioning in lookup because it serves the purpose and more importantly Entire partitioning can be a major performance issue if the data in the reference table is too large.
And of-course the default partitioning method is Auto.
Hope this helped but if you just understand the concept of each partitioning method then it becomes a lot easier for you to explain.
You cannot leave out the Roundrobin partition, as its the best mate for key less operations.
If we point you to check the manuals, anyway you will reply saing, you wanted to know about the experience of the forum users in the usage of partitions, as you did in the other post.
So better, let me not say that.![Wink :wink:](./images/smilies/icon_wink.gif)
If we point you to check the manuals, anyway you will reply saing, you wanted to know about the experience of the forum users in the usage of partitions, as you did in the other post.
So better, let me not say that.
![Wink :wink:](./images/smilies/icon_wink.gif)
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'