Page 1 of 1

Merge Stage Buffer issue?

Posted: Sat Mar 03, 2007 6:39 am
by Havoc
There are 2000+ source sequential files each of around 600 KB.

We are reading these files in a transformer, splitting and joining it using a merge stage. When we run the job,

The Merge stage is failing with an error:

'Operator terminated abnormally,Received signal SIGBUS'

How can we utilize the merge stage's buffer settings? Can someone please throw some light on this ...

Posted: Sat Mar 03, 2007 9:45 am
by ray.wurlod
Dump the score - ascertain whether there are any inserted buffer operators. Without knowing that, it's impossible to advise.

Larger buffers increase memory demand - smaller buffers decrease memory demand but also reduce throughput. Buffering is set (changed from default sizing) on the Advanced tab of an Input link.