Oracle Stage Commit Point

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Nick_6789
Participant
Posts: 32
Joined: Thu Jan 05, 2006 2:07 am

Oracle Stage Commit Point

Post by Nick_6789 »

Hi all,

I have a small question for research purposes.

I have a job that loads data from an sql server stage to Oracle stage. My question involves what is the commit interval set for the oracle stage by default?

Let's say my sql server source involves 10 million records, I don't think it will only commit after inserting 10 million records? It would be disasterous if the connection cuts of in between.

I can't seem to find a setting in Oracle Stage pertaining to this option (Specifying commit intervals).

Would any of you guys know? Thanks in advanced.
Nageshsunkoji
Participant
Posts: 222
Joined: Tue Aug 30, 2005 2:07 am
Location: pune
Contact:

Post by Nageshsunkoji »

Hi,

I think in your case, you can use UR ( Uncomitted Read or dirty read) in the SQL query itself by using WITH UR at the end. Usually we are doing the same thing in DB2 stage.
NageshSunkoji

If you know anything SHARE it.............
If you Don't know anything LEARN it...............
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

There are APT variables that control both the Oracle commit level and frequency, but don't remember their exact name off the top of my head. I'm sure a search of the documentation or this forum will turn them up.
-craig

"You can never have too many knives" -- Logan Nine Fingers
thebird
Participant
Posts: 254
Joined: Thu Jan 06, 2005 12:11 am
Location: India
Contact:

Post by thebird »

The Environment variables available to control the commit intervals are -

APT_ORAUPSERT_COMMIT_ROW_INTERVAL
APT_ORAUPSERT_COMMIT_TIME_INTERVAL

These two environment variables work together to specify how often target rows are committed when using the Upsert method to write to Oracle.
Commits are made whenever the time interval period has passed or the row interval is reached, whichever comes first. By default, commits are made every 2 seconds or 5000 rows.


The Bird
sajarman
Participant
Posts: 41
Joined: Mon Nov 28, 2005 6:29 am

Deciding the Commit intervals.

Post by sajarman »

Hi,

I appreciate if someone can throw light on how to decide the values for Row commit and Commit Time intervals for Oracle.

Thanks,
Sajarman.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

You will need to talk to your DBA in order to make this decision, if you have no business rules for this. The less commits you make, the faster a load can be, but the more the rollback segments fill up. If they reach their limit you will have errors. If you commit too often when you don't have to you end up having a lot of system overhead.
Post Reply