Desperately seeking ... performance-bottlenecks
Posted: Fri Sep 28, 2001 7:59 am
Hi there
Ive got a DataStage batch consisting of a number of jobs each with a number of stages of various forms (nothing particularly fancy and Ive simplifed the description slightly for ease of discussion). I really have 2 related
questions:
* How do I readily identify the rate-limiting job(s) ... I know the
director-log has all the information but finding the info can be time-consuming/error-prone especially when some jobs are run in parallel.
* How do I identify the rate-limiting stage(s) ... I know
director-monitor shows rows-per-sec on links but that is clearly not sufficent in order to understand where best to spend limited time/effort to best value.
The interesting stuff will then come when I try and improve performance in identified areas but Im sure thats a different set of questions!!
Regards
James
This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended addressee, you must
not disclose, copy or take any action in reliance of this transmission.
Although this message and its contents have been scanned for viruses and no
viruses were detected, no responsibility whatsoever is accepted by the
Company, or any of its offices or companies for any loss or damage
arising in any way from receipt or use thereof.
If you have received this email in error please delete this message and notify the Polk System Administrator at postmaster@polkglobal.com.
Ive got a DataStage batch consisting of a number of jobs each with a number of stages of various forms (nothing particularly fancy and Ive simplifed the description slightly for ease of discussion). I really have 2 related
questions:
* How do I readily identify the rate-limiting job(s) ... I know the
director-log has all the information but finding the info can be time-consuming/error-prone especially when some jobs are run in parallel.
* How do I identify the rate-limiting stage(s) ... I know
director-monitor shows rows-per-sec on links but that is clearly not sufficent in order to understand where best to spend limited time/effort to best value.
The interesting stuff will then come when I try and improve performance in identified areas but Im sure thats a different set of questions!!
Regards
James
This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended addressee, you must
not disclose, copy or take any action in reliance of this transmission.
Although this message and its contents have been scanned for viruses and no
viruses were detected, no responsibility whatsoever is accepted by the
Company, or any of its offices or companies for any loss or damage
arising in any way from receipt or use thereof.
If you have received this email in error please delete this message and notify the Polk System Administrator at postmaster@polkglobal.com.