Page 1 of 1
Does Partioning and Parallel Processing go hand in hand
Posted: Tue Apr 12, 2005 11:29 pm
by sriram_h
Does partioning and parallel processing go hand in hand for the increase the performance of various jobs.
We say partioning increases read performance,then what about parallel processing...isn't it the same thing?
Posted: Wed Apr 13, 2005 12:52 am
by roy
Hi,
If you partition a 10GB data to 8 sets of 1.25GB and have 8 processes each processing 1.25GB in paralel, instead of 1 process going over 10GB you gain performance!.
IHTH,
Posted: Wed Apr 13, 2005 12:57 am
by richdhan
Hi Sriram,
Pls go through Chapter 2 of parallel job developers guide. Also search the forum. It has been discussed so many times.
Rich
Posted: Wed Apr 13, 2005 4:25 am
by ray.wurlod
Parallel processing (of which data partitioning is one example) can also overload a system and therefore result in decreased performance. You have to be careful not to demand more resources than can be delivered.