Hi I understood all the partition techniques.
Can any one tell me
which technique used for the which stages
and according to which situation which key based or key less techniques are used ( With small examples)
Thankyou
Which Partition techniques for which stage
Moderators: chulett, rschirm, roy
Which Partition techniques for which stage
Last edited by kstechno on Wed Apr 06, 2011 9:37 pm, edited 1 time in total.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
"The correct one" is the one to choose. Your poll is meaningless.
It's not about stage type, it's about data type of the key for which adjacency needs to be established (Modulus is only for use when the key is an integer of some kind, Hash is the other key-based algorithm to be used for all other data types).
Stage types that need key-partitioned data are those that rely on same key values being on the same partition. These include Join, Merge, Remove Duplicates and Aggregator and may include Transformer and Lookup (and others).
It's not about stage type, it's about data type of the key for which adjacency needs to be established (Modulus is only for use when the key is an integer of some kind, Hash is the other key-based algorithm to be used for all other data types).
Stage types that need key-partitioned data are those that rely on same key values being on the same partition. These include Join, Merge, Remove Duplicates and Aggregator and may include Transformer and Lookup (and others).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ray.wurlod wrote:"The correct one" is the one to choose. Your poll is meaningless.
It's not about stage type, it's about data type of the key for which adjacency needs to be established (Modulus is only for use wh ...
Hi ray thanks for your reply.
I think the way i asked in the poll is wrong one.
And I m not premium member of this website. So that I cant read your message reply.
Any way once again thanks for your reply.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
This link might help.kstechno wrote:And I m not premium member of this website. So that I cant read your message reply.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.