defunct and ghost jobs
Posted: Mon Jul 28, 2003 6:48 am
We have 2 instances of a datastage job running simultaneously on a Sun Solaris server running Datstage 6.01. There are never more than 2 jobs running. When one job ends it starts another one running provided there are no more than 2 jobs running. All these jobs finish with no errors or warnings and they do what we expect them to do.
However, we find that when typing ps -ef after a few minutes (when several jobs will have completed) we see hundreds of defunct processes and old job instances that have actually finished.
We have the dsdlockd process running at the default interval of 900 seconds but after waiting for this period the defunct processes remain.
All these processes eventually disappear but sometimes we get so many that the machine grinds to a halt.
If we turn off the performance options for "enable row buffer inter-process" and just use the default then the problem is reduced. Trouble is the job is then too slow!
Any ideas as to what is happening here? We have not tried specifying a log file path in the dsdlockd.config file. If we did would it tell us if it finds and tries to remove defunct processes?
Pleased to receive any suggestions![Smile :)](./images/smilies/icon_smile.gif)
However, we find that when typing ps -ef after a few minutes (when several jobs will have completed) we see hundreds of defunct processes and old job instances that have actually finished.
We have the dsdlockd process running at the default interval of 900 seconds but after waiting for this period the defunct processes remain.
All these processes eventually disappear but sometimes we get so many that the machine grinds to a halt.
If we turn off the performance options for "enable row buffer inter-process" and just use the default then the problem is reduced. Trouble is the job is then too slow!
Any ideas as to what is happening here? We have not tried specifying a log file path in the dsdlockd.config file. If we did would it tell us if it finds and tries to remove defunct processes?
Pleased to receive any suggestions
![Smile :)](./images/smilies/icon_smile.gif)