Job Hanging since using Link Collectors and enabling IPC

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
patonp
Premium Member
Premium Member
Posts: 110
Joined: Thu Mar 11, 2004 7:59 am
Location: Toronto, ON

Job Hanging since using Link Collectors and enabling IPC

Post by patonp »

Since adding a link collector to a job, the job hangs after processing roughly 800 rows each time I attempt to run it. I've selected the Inter Process mode (as required by a link collector) and incrementally increased the Buffer size and timeout values to 1024 Kb and 40 sec respectively, but the problem is still occurring.

Any suggestions?

Thanks,

Peter
densons
Participant
Posts: 2
Joined: Thu Mar 18, 2004 9:52 am
Location: Atlanta, GA

Re: Job Hanging since using Link Collectors and enabling IPC

Post by densons »

How is your job laid out? I know you have multiple source stages going into the link collector but what is the output of the link collector. Are you staging the results into a file or sending the output directly to a transformer stage?

I think it is best practice to place the results of the link collector stage to a file before moving to a transformer or target stage. This can be a diskspace hog but it has worked for me.

If this does not help, give me more information about your problem.

S Denson
patonp wrote:Since adding a link collector to a job, the job hangs after processing roughly 800 rows each time I attempt to run it. I've selected the Inter Process mode (as required by a link collector) and incrementally increased the Buffer size and timeout values to 1024 Kb and 40 sec respectively, but the problem is still occurring.

Any suggestions?

Thanks,

Peter
ariear
Participant
Posts: 237
Joined: Thu Dec 26, 2002 2:19 pm

Post by ariear »

I had the same problem - changed to collecting mode -round robin and It worked !
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

I've only been able to get round-robin working with the link collector, using the sorting method usually hangs my job (version 7 on Sun Solaris). In one case I used a link collector in round-robin mode followed by a sort stage for a job where extreme performance wasn't a priority.
Post Reply