HI
i am using ODBC stage and i want to commit after every 1000 records,
what Environment Variable should be used,and what is use of Array size?
so if i use after commiting 1000 reocrds, and the job got Aborted,then if i start once again wheteher it will start from the starting or where it is aborted at the record level.
Commit after some records in ODBC stage
Moderators: chulett, rschirm, roy
Commit after some records in ODBC stage
Last edited by jpraveen on Fri Sep 17, 2010 5:32 am, edited 1 time in total.
Jaypee
The transaction size is the commit level, atleast in server. Do not have access to a parallel engine at the moment so cannot confirm what property it is on your side.
The array size is the number of rows in one trip to your database server.
For restartability at the row level, there is nothing out of the box, unless you commit at the end of your job. For restartability with inremental commits , you will have to design your job to handle that.
The array size is the number of rows in one trip to your database server.
For restartability at the row level, there is nothing out of the box, unless you commit at the end of your job. For restartability with inremental commits , you will have to design your job to handle that.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
As noted, Array Size controls how many records are sent at one time across the network to the database. The setting for Transaction Size controls the commit level. While some of the native stages (OE) use environment variables to control that, I do not believe that the ODBC stage does, there should be a property in the stage for that.
I'm off in a hotel (with flaky internet access, it seems) for the weekend and don't have access to any documentation or I would check, so you'll need to do that. That or wait for someone else to chime in who can confirm or deny.
I'm off in a hotel (with flaky internet access, it seems) for the weekend and don't have access to any documentation or I would check, so you'll need to do that. That or wait for someone else to chime in who can confirm or deny.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
Re: Commit after some records in ODBC stage
HI,jpraveen wrote:HI
i am using ODBC stage and i want to commit after every 1000 records,
what Environment Variable should be used,and what is use of Array size?
so if i use after commiting 1000 reocrds, and the job got Aborted,then if i start once again wheteher it will start from the starting or where it is aborted at the record level.
See to the environment variables to check the commit intervals,
For Oracle below are the variables
APT_ORAUPSERT_COMMIT_ROW_INTERVAL - oracle commits after this many rows.
APT_ORAUPSERT_COMMIT_TIME_INTERVAL - oracle commits after this many seconds.
Oracle commits whichever condition meets first.