Since adding a link collector to a job, the job hangs after processing roughly 800 rows each time I attempt to run it. I've selected the Inter Process mode (as required by a link collector) and incrementally increased the Buffer size and timeout values to 1024 Kb and 40 sec respectively, but the problem is still occurring.
Any suggestions?
Thanks,
Peter
Job Hanging since using Link Collectors and enabling IPC
Moderators: chulett, rschirm, roy
Re: Job Hanging since using Link Collectors and enabling IPC
How is your job laid out? I know you have multiple source stages going into the link collector but what is the output of the link collector. Are you staging the results into a file or sending the output directly to a transformer stage?
I think it is best practice to place the results of the link collector stage to a file before moving to a transformer or target stage. This can be a diskspace hog but it has worked for me.
If this does not help, give me more information about your problem.
S Denson
I think it is best practice to place the results of the link collector stage to a file before moving to a transformer or target stage. This can be a diskspace hog but it has worked for me.
If this does not help, give me more information about your problem.
S Denson
patonp wrote:Since adding a link collector to a job, the job hangs after processing roughly 800 rows each time I attempt to run it. I've selected the Inter Process mode (as required by a link collector) and incrementally increased the Buffer size and timeout values to 1024 Kb and 40 sec respectively, but the problem is still occurring.
Any suggestions?
Thanks,
Peter
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
I've only been able to get round-robin working with the link collector, using the sorting method usually hangs my job (version 7 on Sun Solaris). In one case I used a link collector in round-robin mode followed by a sort stage for a job where extreme performance wasn't a priority.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn