IPC Stage Vs Inter-Process Row Bufferring

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
andru
Participant
Posts: 21
Joined: Tue Mar 02, 2004 12:25 am
Location: Chennai

IPC Stage Vs Inter-Process Row Bufferring

Post by andru »

Currently, in all our jobs we are using a IPC stage to achieve the parallelism explicitly. But if we can turn on the project level setting to inter-process buffering, then we can avoid using IPC stage in all our jobs. By this way we can gain lot of effort involved in coding this stage in all our hundreds of jobs.
Please let me know if there will be a performance difference between these two methods.
roy
Participant
Posts: 2598
Joined: Wed Jul 30, 2003 2:05 am
Location: Israel

Post by roy »

Hi,
there is no way using project defaults to make DS plant IPC stage for you, this option simply alows you to set the default buffer size for new jobs.
in any case it can be override in any job if you reset the values.
bare in mind that it has, as does row buffering, effects on common use of variables between active stages in case you use it and the effect is again project wide for new jobs.

IHTH,
Roy R.
Time is money but when you don't have money time is all you can afford.

Search before posting:)

Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Image
shawn_ramsey
Participant
Posts: 145
Joined: Fri May 02, 2003 9:59 am
Location: Seattle, Washington. USA

Post by shawn_ramsey »

It was my understanding that turning on the inter-process buffering at the project level would cause DataStage to implicitly set up IPC between 2 active stages when it compiled the job.
Shawn Ramsey

"It is a mistake to think you can solve any major problems just with potatoes."
-- Douglas Adams
tonystark622
Premium Member
Premium Member
Posts: 483
Joined: Thu Jun 12, 2003 4:47 pm
Location: St. Louis, Missouri USA

Post by tonystark622 »

It only affects jobs whose Job Properties are set to "Project Default".
Post Reply