Does Partioning and Parallel Processing go hand in hand

sriram_h · Post by **sriram_h** » Tue Apr 12, 2005 11:29 pm

Does partioning and parallel processing go hand in hand for the increase the performance of various jobs.

We say partioning increases read performance,then what about parallel processing...isn't it the same thing?

roy · Post by **roy** » Wed Apr 13, 2005 12:52 am

Hi,
If you partition a 10GB data to 8 sets of 1.25GB and have 8 processes each processing 1.25GB in paralel, instead of 1 process going over 10GB you gain performance!.

IHTH,

richdhan · Post by **richdhan** » Wed Apr 13, 2005 12:57 am

Hi Sriram,

Pls go through Chapter 2 of parallel job developers guide. Also search the forum. It has been discussed so many times.

Rich

ray.wurlod · Post by **ray.wurlod** » Wed Apr 13, 2005 4:25 am

Parallel processing (of which data partitioning is one example) can also overload a system and therefore result in decreased performance. You have to be careful not to demand more resources than can be delivered.