Datastage extracts & UniVerse Transaction Logging problem
Posted: Tue Nov 18, 2003 1:56 pm
Does Datastage start a database transaction which remains open until the
extract job is complete?
Why? Is there any way to turn off this "feature"?
We use Datastage to extract data from our Universe(UV) database. My own
expertise, if any, is with Universe, not Datastage, so be gentle.
I have correlated
(a) UV transaction logs that fill, and get left in a "Need Sync" state
(with a corresponding message in the uvchkd.info file saying "...1
pending transaction(s)...",
with
(b) Datastage extracts that start when that log is "current" and have
not finished until well after that log has filled.
When the DS job finishes, the log(s) progress to their normal "Full" or
"Released" status.
We have one extract that runs for several hours and during that time the
UV db will fill 1-2GB worth of logs. They ALL remain in the "Need Sync"
state until the Datastage job finishes. If we actually crashed during
that time, we'd have to apply 1-2GB worth of logs during warmstart
recovery. Also, these logs cannot be archived to tape. More mischief
if the datastage job ever aborted for any reason.
Is there an for this datastage-users list that I could have searched for
this?
Thank-you in advance,
Charles Stevenson
DBA
BP/IS
Getronics
836 North Street
Tewksbury, MA 01876
Tel: 978-858-6872
Fax: 978-858-8631
charles.stevenson@getronics.com
www.getronics.com/us The information transmitted is intended only for
use by the addressee and may contain confidential and or or privileged
material. Any review, re-transmission, dissemination or other use of it,
or the taking of any action in reliance upon this information by persons
and or or entities other than the intended recipient is prohibited. If
you received this in error, please inform the sender and/or addressee
immediately and delete the material. Thank you.
extract job is complete?
Why? Is there any way to turn off this "feature"?
We use Datastage to extract data from our Universe(UV) database. My own
expertise, if any, is with Universe, not Datastage, so be gentle.
I have correlated
(a) UV transaction logs that fill, and get left in a "Need Sync" state
(with a corresponding message in the uvchkd.info file saying "...1
pending transaction(s)...",
with
(b) Datastage extracts that start when that log is "current" and have
not finished until well after that log has filled.
When the DS job finishes, the log(s) progress to their normal "Full" or
"Released" status.
We have one extract that runs for several hours and during that time the
UV db will fill 1-2GB worth of logs. They ALL remain in the "Need Sync"
state until the Datastage job finishes. If we actually crashed during
that time, we'd have to apply 1-2GB worth of logs during warmstart
recovery. Also, these logs cannot be archived to tape. More mischief
if the datastage job ever aborted for any reason.
Is there an for this datastage-users list that I could have searched for
this?
Thank-you in advance,
Charles Stevenson
DBA
BP/IS
Getronics
836 North Street
Tewksbury, MA 01876
Tel: 978-858-6872
Fax: 978-858-8631
charles.stevenson@getronics.com
www.getronics.com/us The information transmitted is intended only for
use by the addressee and may contain confidential and or or privileged
material. Any review, re-transmission, dissemination or other use of it,
or the taking of any action in reliance upon this information by persons
and or or entities other than the intended recipient is prohibited. If
you received this in error, please inform the sender and/or addressee
immediately and delete the material. Thank you.