Job failing with Broken Pipe Error

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mac4rfree85
Participant
Posts: 126
Joined: Thu Jul 01, 2010 11:39 pm

Job failing with Broken Pipe Error

Post by mac4rfree85 »

Hi Guys,

I am getting the below error.

Code: Select all

APT_CombinedOperatorController,0: terminate called after throwing an instance of 'APT_BadAlloc'
APT_CombinedOperatorController,0: /bin/echo: write error: Broken pipe
The Job is running fine if i am running the job for fewer records.

Can somebody guide me as how to tackle the problem.

Cheers!!!
Mac4rfree
abhinavagarwal
Participant
Posts: 26
Joined: Thu Jun 19, 2008 12:39 am
Location: Atlanta

Post by abhinavagarwal »

check your buffers and scratch disk space ... they are getting full while you are running with large data... allocate some more memory to them.
mac4rfree85
Participant
Posts: 126
Joined: Thu Jul 01, 2010 11:39 pm

Post by mac4rfree85 »

I increased the Buffer Size to 10485760 by adding the env variable $APT_BUFFER_MAXiMUM_MEMORY and also added the env variable $APT_BUFFER_FREE_RUN to 1. But still the job is getting the same error.

Can you somebody help me with this.
Mac4rfree
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

You probably need more disk space rather than higher settings, have you tried monitoring that while the job runs?
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply