PX job memory leak...

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
pneumalin
Premium Member
Premium Member
Posts: 125
Joined: Sat May 07, 2005 6:32 am

PX job memory leak...

Post by pneumalin »

Friends,
Does anyone know how to dectect the Memory Leak caused PX jobs and clean it up in runtime...
Why I am asking for this?
Since we had a PX job using Enterprise DB2 stage to perform load to Remote DB2 Server, and this job constantly Hangs to timeout in 2 hours for no reason. But it load through once it is restarted.. Our DBA was monitoring the DB2 activity at that time and found out there is no data written to the Named-Pipe for 2 hours where DB2 Loader is trying to read.
Therefore we suspect the PX Engines lost the communnication link at that moment to cause the Hang. Furthermore, the restart works ensure us there must be a resource issue in DataStage Engine runtime and it get cleared once the Job is restarted..
Just try to find a way to debug the problem, any advise is welcome!
Thanks.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Have you specified "all rows in single transaction"?

Is it really a memory leak or just consuming a lot of memory that it will relinquish once it's done? A memory leak is a bug, using a lot of memory is not.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
pneumalin
Premium Member
Premium Member
Posts: 125
Joined: Sat May 07, 2005 6:32 am

Post by pneumalin »

Ray,
Is "All row in a single transaction" a DB2 setup option for DBA? Or we can set it from Enterprise DB2/UDB Stage? I don't see this option in that Stage though? I am running 7.5.0.
Please advise.
Thanks!
Post Reply