Does partioning and parallel processing go hand in hand for the increase the performance of various jobs.
We say partioning increases read performance,then what about parallel processing...isn't it the same thing?
Does Partioning and Parallel Processing go hand in hand
Moderators: chulett, rschirm, roy
Hi,
If you partition a 10GB data to 8 sets of 1.25GB and have 8 processes each processing 1.25GB in paralel, instead of 1 process going over 10GB you gain performance!.
IHTH,
If you partition a 10GB data to 8 sets of 1.25GB and have 8 processes each processing 1.25GB in paralel, instead of 1 process going over 10GB you gain performance!.
IHTH,
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Parallel processing (of which data partitioning is one example) can also overload a system and therefore result in decreased performance. You have to be careful not to demand more resources than can be delivered.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.