Sort problem

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Cesar Augusto
Premium Member
Premium Member
Posts: 4
Joined: Mon Jun 18, 2007 3:45 pm

Sort problem

Post by Cesar Augusto »

Hi all

Well, I did a parallel job, and i used a 'Join' stage.
So, when the job ran with the real data (40,000,000 rows), the job aborted in the 'Join' stage, and show the error messages below:

"APT_ParallelSortMergeOperator,0: Failure during execution of operator logic."
"APT_CombinedOperatorController,0: Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed."
"Join_CCR_Keys,0: Failure during execution of operator logic."
"Join_CCR_Keys,0: Fatal Error: waitForWriteSignal(): Premature EOF on node apdtcp001 No such file or directory"
"node_node2: Player 11 terminated unexpectedly."
"node_node1: Player 9 terminated unexpectedly."
"subArgs={asc}}},0: Failure during execution of operator logic."
"subArgs={asc}}},0: Fatal Error: Unable to allocate communication resources"
"TRF_JOIN,2: Failure during execution of operator logic."
"TRF_JOIN,2: Fatal Error: Unable to allocate communication resources"
...

Another programer said to use a "Sort" stage before the "Join"... this will works?

thanks for the atention
prasadduvasi
Participant
Posts: 19
Joined: Wed Feb 15, 2006 11:08 am

Post by prasadduvasi »

Prasad Duvasi
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You are running out of both memory and communication resources. This suggests that your server is overloaded.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply