Inter process Stage

myukassign · Post by **myukassign** » Thu Jul 31, 2008 2:57 am

I have an informational doubt...

Would appriciate if anyone can help....

I know IPC (inter process stage) can be used to improve the perfomance in data transferring between passive stages or in some cases between active stages also.

So a natural question coming to my mind is, I wish to have good perfoamnce in ech of my desgin... so I can use it everywhere ....

My question is... Where this IPC stage fits is? in what all situvations I should use this IPC stage.... Some examples will help me to understand the concept better

eostic · Post by **eostic** » Thu Jul 31, 2008 8:50 am

It is NOT something to be used lightly....it creates additional processes when you need them, allowing you to so some very customized parallelism. It's the "manual" method over just setting interprocess row buffering for the whole job...in either case, it's something you should use carefully, if you want to segment one part of the job into its own process. Turning it on for the whole job without careful testing is dangerous because it can change the behavior, particularly for jobs that depend on specific order of execution and individual row processing. Either way, it's something to apply with care, possibly helping you push more rows thru the job, giving you custom degrees of pipelining.

Ernie