Page 1 of 1

Performance Tuning

Posted: Sat Mar 31, 2007 2:11 am
by muruganr117
I would like to know the different ways which are generally used for performance tuning of Server jobs. Kindly reply me in this regard.

Posted: Sat Mar 31, 2007 4:23 am
by ray.wurlod
Welcome aboard. :D

The key performance indicator in ETL is elapsed time. If you can get the data in - or out, as the case may be - within the allowed time window, with a safety margin, then your ETL is performing satisfactorily.

The strongest mechanism for tuning that performance, therefore, is expectation management. And education that:
  • correct is far more important than fast and that that is where you should concentrate your efforts

    rows/sec is an almost entirely useless metric

Re: Performance Tuning

Posted: Wed May 16, 2007 12:32 am
by baglasumit21
muruganr117 wrote:I would like to know the different ways which are generally used for performance tuning of Server jobs. Kindly reply me in this regard.
There are many thing you can do but it depends solely on your requirements. some of the points are as below.

1) Supplying a sorted input to Aggregator stage
2) Enabling Cache for the hash file
3) Avoid using joins in the source query if you can replace it with hash file and look-up
4) If possible divide the extraction and loading process in a job into 2 different jobs by landing the data in intermediate seq. file and loading the target from the file.

Posted: Wed May 16, 2007 12:49 am
by ray.wurlod
Manage expectations.