Merge Stage Buffer issue?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Havoc
Participant
Posts: 110
Joined: Fri Nov 24, 2006 8:26 am

Merge Stage Buffer issue?

Post by Havoc »

There are 2000+ source sequential files each of around 600 KB.

We are reading these files in a transformer, splitting and joining it using a merge stage. When we run the job,

The Merge stage is failing with an error:

'Operator terminated abnormally,Received signal SIGBUS'

How can we utilize the merge stage's buffer settings? Can someone please throw some light on this ...
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Dump the score - ascertain whether there are any inserted buffer operators. Without knowing that, it's impossible to advise.

Larger buffers increase memory demand - smaller buffers decrease memory demand but also reduce throughput. Buffering is set (changed from default sizing) on the Advanced tab of an Input link.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply