Page 1 of 1

How can i improve the performence in Sequcece

Posted: Fri Feb 15, 2008 12:33 am
by 4friends
hi,

Presently iam running the production jobs. which contains 130 jobs,
these are all divided into 8 sequences.All to these sequences are add into one main sequence.
Previously the total elapsed time was around 9 hrs,
but presently it was 13.5 hrs. But there is no changes in the jobs. how can i improve the performance of the sequence.

Posted: Fri Feb 15, 2008 2:18 am
by ray.wurlod
Why has the total elapsed time increased by 50%? Are you processing a greater volume of data? How hard are you working your machine? Are there "running in parallel" or "time shifting" opportunities to be had to even out the load on the machine? These are just some ideas to get you started.

Posted: Fri Feb 15, 2008 4:23 am
by 4friends
Yes, greater volume of data but not that much.
At the time of development they are using only joins and at Query level.
they are not using any other. All the logic was inserted in query. Not using any stages only transformer stage.

Posted: Fri Feb 15, 2008 6:33 am
by priyadarshikunal
4friends wrote:Yes, greater volume of data but not that much.
At the time of development they are using only joins and at Query level.
they are not using any other. All the logic was inserted in query. Not using any stages only transformer stage.
Havn't got all the answers :?

Greater volume of data will increse the load time.

Some Questions (1st one inherits Ray's Question):

1. Are you running jobs in parellel?

2. Is there any thing else consuming the resources while you are running your jobs?

Few Suggestions:

1. Try to call the maximum number of jobs at a time if the resources and dependecies permit.

2. Tuning your queries may reduce the load time.

Regards,

Posted: Fri Feb 15, 2008 7:25 am
by chulett
You have some work to do. Where did this increase come from, any jobs in particular? Identify the culprits, then you'll know where to concentrate your efforts.