Should it be In Process or Inter Process and how does it behave. How much should I select for buffer size.
But still I am thinking about the IPC stage not working and the reason for it.
Thanks,
How to avoid using flat files & connect transformers out
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 9
- Joined: Tue Apr 05, 2005 4:39 am
Hai Vinay,
I have a solution for your query. let me say how i have solved. i have taken three inputs each connected to tranformer and now i have 3 transformers and i have linked them to Link Collector. in the job properties-->Performance enable row buffering to inter process. there is no need of using IPC stage after transformer. let the size be default and have a look below how inprocess and inter process behaves
•In process. You can improve the performance of most DataStage jobs by turning in-process row buffering on and recompiling the job. This allows connected active stages to pass data via buffers rather than row by row.
•Inter process. Use this if you are running server jobs on an SMP parallel system. This enables the job to run using a separate process for each active stage, which will run simultaneously on a separate processor.
i think now u have got it
RAVI
I have a solution for your query. let me say how i have solved. i have taken three inputs each connected to tranformer and now i have 3 transformers and i have linked them to Link Collector. in the job properties-->Performance enable row buffering to inter process. there is no need of using IPC stage after transformer. let the size be default and have a look below how inprocess and inter process behaves
•In process. You can improve the performance of most DataStage jobs by turning in-process row buffering on and recompiling the job. This allows connected active stages to pass data via buffers rather than row by row.
•Inter process. Use this if you are running server jobs on an SMP parallel system. This enables the job to run using a separate process for each active stage, which will run simultaneously on a separate processor.
i think now u have got it
![Wink :wink:](./images/smilies/icon_wink.gif)
RAVI
-
- Participant
- Posts: 3337
- Joined: Mon Jan 17, 2005 4:49 am
- Location: United Kingdom
-
- Premium Member
- Posts: 353
- Joined: Wed Apr 06, 2005 8:45 am
How to avoid using flat files & connect transformers out
vinaymanchinila wrote:I have used 3 IPC stages and then directly connected them to an Link collector and then to the target.
The Issue is all the 3 transformers run fine and when the link comes to the IPC stage it just shows running. I stopped the job and increased the IPC connection time out to 999999. Still the job does not execute!.
Any help would be appreciated.
I used the above logic and it worked for me.
-Yamini
-
- Participant
- Posts: 9
- Joined: Tue Apr 05, 2005 4:39 am
Re: How to avoid using flat files & connect transformers
[quote="vinaymanchinila"]Hi,
I have 3 transformers generating data with same metadata. Instead of staging it into 3 flat files and merge them and load into Target, is there a way I can avoid the flat files and merge the output of the transformers . I did use the link collector but it doesnt take active inputs!
Thanks[/quote]
How about going to "Job Properties" -> "Performance"
i) uncheck Project Details
ii) check Enable Row Buffer
iii) select Inter Process
Recompile and Run.
I have 3 transformers generating data with same metadata. Instead of staging it into 3 flat files and merge them and load into Target, is there a way I can avoid the flat files and merge the output of the transformers . I did use the link collector but it doesnt take active inputs!
Thanks[/quote]
How about going to "Job Properties" -> "Performance"
i) uncheck Project Details
ii) check Enable Row Buffer
iii) select Inter Process
Recompile and Run.
-
- Premium Member
- Posts: 353
- Joined: Wed Apr 06, 2005 8:45 am