Hi All,
my requirement is ,i am using join stage and also look-up stage s in my jobs,what is the best partitioning method for Look-up stage as well as Join stage . i am running on 2-node config file.
by default i am using auto-partition
though we give this as Auto -partitioning,what type of partitioning will take the datastage internally?
Best partitioning method
Moderators: chulett, rschirm, roy
Best partitioning method
Jaypee
-
- Premium Member
- Posts: 258
- Joined: Tue Jul 04, 2006 10:35 pm
- Location: Toronto
Re: Best partitioning method
Use any key based partitioning method.
-
- Premium Member
- Posts: 258
- Joined: Tue Jul 04, 2006 10:35 pm
- Location: Toronto
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
That's too simplistic. You not only have to use a key-based algorithm, but you must also make sure that the partitioning is based on (at least the first) join key and that the algorithm will yield sufficient distinct values to spread data across all the available nodes.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.