Hi, My job loads data from Oracle stage into a data set, there are around 6 columns and 200K records. We are doing some inner joins in Oracle stage itself, job takes around 2 hrs to finish on 8 nodes.
My question is what will be the best way to increase the performance of the job ? Is writing a join sql in oracle stage better than using join or look up stages.
Thanks in Advance
Oracle stage performance
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 397
- Joined: Wed Apr 12, 2006 2:28 pm
- Location: Tennesse
Oracle stage performance
hi sam here
Try testing different ways. How much time does the same query take in Toad? IF the fetching of data is not the bottleneck then try playing with the number of nodes, start from 2,4 etc.
What does your design look like, are you re-partitioning the keys before loading the dataset?
What does your design look like, are you re-partitioning the keys before loading the dataset?
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
-
- Premium Member
- Posts: 397
- Joined: Wed Apr 12, 2006 2:28 pm
- Location: Tennesse