Slowness in executing jobs

[cosec]

Hi All,

We are encountering slow performance when jobs are executed via Datastage v8.1. When compared to executing the jobs via the Previous version (v7.5.2) the jobs are running 3 times slow in when using v8.1.

The system meets the required hardware resources.

Appreciate if anyone could advise on which area to look at to improve the performace and also whether the following commands can cause slowness when using v8.1. Thanks.:


dsjob -run ${DS_PROJECT_NAME} ${DS_JOB_NAME}

dsjob -server ${DSSERVER} -user ${DSUSERID} -password ${DSPASSWORD} -jobinfo ${DATASTAGEPROJECT} ${JobName} >> ${POST_JOB_LOG_FILE}

dsjob -jobinfo ${DATASTAGE_PROJECT_NAME} ${DATASTAGE_JOB_NAME} > ${POST_JOB_LOG_FILE}

dsjob -logsum ${DATASTAGE_PROJECT_NAME} ${DATASTAGE_JOB_NAME} > ${FULL_INFO_LOG_FILE}

dsjob -logdetail ${DATASTAGE_PROJECT_NAME} ${SUB_JOB} ${START_LOG_F} ${END_LOG_F} >> ${SUB_JOB_FULL_INFO_LOG_FILE}

[Sainath.Srinivasan]

DS 8 does consume quite lot of memory.

But you have given very limited information on what may cause the delay.

Try different types of jobs and locate which action causes the delay. Then it will easy to eradicate the problem.

[chulett]

I don't know about 3x slower but 8.x jobs are known to be "slower" than their 7.x brethren. Your two "-log" calls from the command line may be the worst culprits... are your logs in the XMETA database or in hashed files?

[kduke]

Define slower. It went from 3 minutes to 9 minutes? It went from 3 hours to 9 hours? These are vastly different problems.