Perfomance tuning in sort stage.
Posted: Sun Dec 21, 2008 11:49 am
Hi,
Iam working in datastage 7.5, In one of the job we are processing more than 400 million records which fetches data from seq file and udb stage and feed to UDB stage. we are using copy, filter and sort stage as intermediate to do business validation. I need to reduce the run time of the, Job usually takes more than 5 to 6 hours.
Sort stage might be taking significant time so iam looking for change something in sort stage. Sort stage based on a key to remove duplicate and sort data in ascending order. It is possible to reduce time.
We have one option in properties tab of sort stage.
Restrict memory usage set to default
Whether increasing the Restrict memory usage will increase performance of the job?
Please advise me to do performance tuning. __.____._
Iam working in datastage 7.5, In one of the job we are processing more than 400 million records which fetches data from seq file and udb stage and feed to UDB stage. we are using copy, filter and sort stage as intermediate to do business validation. I need to reduce the run time of the, Job usually takes more than 5 to 6 hours.
Sort stage might be taking significant time so iam looking for change something in sort stage. Sort stage based on a key to remove duplicate and sort data in ascending order. It is possible to reduce time.
We have one option in properties tab of sort stage.
Restrict memory usage set to default
Whether increasing the Restrict memory usage will increase performance of the job?
Please advise me to do performance tuning. __.____._