Performance Tuning

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
attu
Participant
Posts: 225
Joined: Sat Oct 23, 2004 8:45 pm
Location: Texas

Performance Tuning

Post by attu »

I have a question relating to job performance, one of the job is doing a normal lookup directly from the oracle table to retrieve ID, there are over 9 million records in the table and this lookup causes the performance to decrease.
how can i increase the efficiency of this job?

Thanks
ankita
Participant
Posts: 57
Joined: Sun Nov 13, 2005 11:17 pm

Post by ankita »

Use join instead of lookup keeping the inputs hash partitioned and sorted on join keys.

Regards,
Ankita
vijayrc
Participant
Posts: 197
Joined: Sun Apr 02, 2006 10:31 am
Location: NJ

Re: Performance Tuning

Post by vijayrc »

attu wrote:I have a question relating to job performance, one of the job is doing a normal lookup directly from the oracle table to retrieve ID, there are over 9 million records in the table and this lookup causes the performance to decrease.
how can i increase the efficiency of this job?

Thanks
Yes...If lookup isn't upto what you look for, go with the JOIN.
Also instead of directly lookup on Oracle table, you can try dumping the oracle table first, and then Join with this dumped file [if the table is more of a static one]
attu
Participant
Posts: 225
Joined: Sat Oct 23, 2004 8:45 pm
Location: Texas

Post by attu »

Thanks Vijay and Ankita
Post Reply