IPC Stage
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 232
- Joined: Fri Sep 30, 2005 4:52 am
- Contact:
IPC Stage
Hi all,
Is there any performance benifit of using IPC stage ?
In which cases we can use IPC stage
Thanks,
Anupam
Is there any performance benifit of using IPC stage ?
In which cases we can use IPC stage
Thanks,
Anupam
Re: IPC Stage
You can use IPC Stage to specify that connected active stage should run as seperate processes.sb_akarmarkar wrote:Hi all,
Is there any performance benifit of using IPC stage ?
In which cases we can use IPC stage
Thanks,
Anupam
You can also use IPC stage between two passive stages to speed up transfer of data between them.
It can even speed up if it is conected between two passive stage. Its done by pipeline parallelism. i.e., as soon as the link is open for input to the IPC stage, the output link is also opened parallel, so in SMP or MPP the transfer rate will be more faster. It also enables inter process buffering between active stages.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
-
- Participant
- Posts: 232
- Joined: Fri Sep 30, 2005 4:52 am
- Contact:
Re: IPC Stage
Hi balajisr,balajisr wrote: You can use IPC Stage to specify that connected active stage should run as seperate processes.
You can also use IPC stage between two passive stages to speed up transfer of data between them.
If suppose one of my process in ETL is taking 3 min to execute and another 20 min, so is it feasible to use IPC Stage....
Thanks,
Anupam
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The answer is a definite maybe. It really does depend on what your job is doing.
If
stage ---> IPC ---> stage ---> IPC ---> stage
runs faster than
stage ---> stage ---> stage
then would
stage ---> IPC ---> IPC ---> stage ---> IPC ---> IPC ---> stage
run even faster?
The answer is no, for the same reason that nine women can't have a baby in one month.
If
stage ---> IPC ---> stage ---> IPC ---> stage
runs faster than
stage ---> stage ---> stage
then would
stage ---> IPC ---> IPC ---> stage ---> IPC ---> IPC ---> stage
run even faster?
The answer is no, for the same reason that nine women can't have a baby in one month.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Re: IPC Stage
But may I know, how you calculated the time taken by each process?sb_akarmarkar wrote:Hi balajisr,balajisr wrote: You can use IPC Stage to specify that connected active stage should run as seperate processes.
You can also use IPC stage between two passive stages to speed up transfer of data between them.
If suppose one of my process in ETL is taking 3 min to execute and another 20 min, so is it feasible to use IPC Stage....
Thanks,
Anupam
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
-
- Participant
- Posts: 232
- Joined: Fri Sep 30, 2005 4:52 am
- Contact:
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Active stage execution times are reported to the nearest millisecond in the job log, in "active stage finishing" messages.
You can also enable statistics collection (to the nearest microsecond) on the Tracing tab of the Job Run Options dialog when requesting a job run from Director.
You can also enable statistics collection (to the nearest microsecond) on the Tracing tab of the Job Run Options dialog when requesting a job run from Director.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.