Oracle stage performance

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
samsuf2002
Premium Member
Premium Member
Posts: 397
Joined: Wed Apr 12, 2006 2:28 pm
Location: Tennesse

Oracle stage performance

Post by samsuf2002 »

Hi, My job loads data from Oracle stage into a data set, there are around 6 columns and 200K records. We are doing some inner joins in Oracle stage itself, job takes around 2 hrs to finish on 8 nodes.

My question is what will be the best way to increase the performance of the job ? Is writing a join sql in oracle stage better than using join or look up stages.

Thanks in Advance
hi sam here
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Try testing different ways. How much time does the same query take in Toad? IF the fetching of data is not the bottleneck then try playing with the number of nodes, start from 2,4 etc.
What does your design look like, are you re-partitioning the keys before loading the dataset?
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
samsuf2002
Premium Member
Premium Member
Posts: 397
Joined: Wed Apr 12, 2006 2:28 pm
Location: Tennesse

Post by samsuf2002 »

Thanks for your reply DSguru2B.

I will try the steps you showed me and my job design is just an oracle stage followed by data set. I am using auto partitioning on data set.
hi sam here
Post Reply