IPC stage

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
Xpert
Premium Member
Premium Member
Posts: 85
Joined: Wed Mar 01, 2006 7:17 am

IPC stage

Post by Xpert »

Hi,

Tell me, where it is preferred to have IPC stage and where it is preferred to have Link Partioner & Collector stage.
With regards,
Xpert
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Welcome aboard. :D

They are unrelated. IPC implements and makes visible pipeline parallelism in server jobs, while the Link Partitioner/Collector stages implement and make visible partition parallelism.

For more information read Chapter 2 of Parallel Job Developer's Guide
Last edited by ray.wurlod on Thu Jun 22, 2006 1:41 pm, edited 1 time in total.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

If two active stage are connected to gether, the process are clubbed together. If an IPC is used in mid of it, the both process are mutually exclusive.
If you need parallalism, you can use Link partitionor. If you have 64links out of it, you input record set will be processed parallely in all the 64 link, each record in each link.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

If two active stages are linked together, and inter-process row buffering is enabled, then the two active stages will operate in separate processes whether or not there is an IPC stage placed on the link. The IPC stage simply makes the process boundary visible in the job design, and gives a mechanism for changing the buffer size and timeout specifically for that link.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

IPC would be a key through with the link level row buffering parameters (buffer size and timeout )can be altered or changed. (The value, if set in project level in row buffering)
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
Post Reply