Oracle table load

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
just4u_sharath
Premium Member
Premium Member
Posts: 236
Joined: Sun Apr 01, 2007 7:41 am
Location: Michigan

Oracle table load

Post by just4u_sharath »

Hello
I have a question. When i am loading Oracle table from datastage, the load was very slow. In what way i can increase the load speed. Please mention all the possible ways to increase the load speed. Currenltly the load was very slow. It was around 700 records per second. Please reply
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

Sarath
it depends on your requirement.
you should give full details about your current design and your requirements.
what type of load is used? i guess it is upsert.
is the table partitioned ?
just4u_sharath
Premium Member
Premium Member
Posts: 236
Joined: Sun Apr 01, 2007 7:41 am
Location: Michigan

Post by just4u_sharath »

keshav0307 wrote:Sarath
it depends on your requirement.
you should give full details about your current design and your requirements.
what type of load is used? i guess it is upsert.
is the table partitioned ?
Yes the table is partitioned.
Can i use the ORABULK stage. What are the constraints i have if i use orabulk stage.
Its just load. Nothing to worry about the business requirements.
Currenlty i am using upsert. But if possibe with orabulk i can only use insert statements
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

do you limitations of the UPSERT and Bulk Load.
Bulk load is used for only insert but you have to also consider the index.
Indexes play important role in both.

read the parallel job developers guide guide chapter 13
prabu
Participant
Posts: 146
Joined: Fri Oct 22, 2004 9:12 am

Re: Oracle table load

Post by prabu »

just4u_sharath wrote:Hello
Please mention all the possible ways to increase the load speed (for Oracle load).
Hi,


For fact load
========

1) If it is an append of records, load into a temporary table . then exchange this temp table into the daily partition.

2) go for bulk/direct path load.

3)Run the load stand-alone (As in 2). Collect statistics

4)Tune 3 until satisfied

5) Simulate the process from DS.

6)collect system statistics. if needed add more h/w

hope this helps!

regards,
Prabu
Post Reply