Reject records=No Warning, so how to detect rejected

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
pnpmarques
Participant
Posts: 35
Joined: Wed Jun 15, 2005 9:27 am

Reject records=No Warning, so how to detect rejected

Post by pnpmarques »

Hello,
I have a job that loads data with Oracle Enterprise Stage, Upsert mode.
For some reason, like Foreign Key constraints or inserting Null into a Not Null column, I get rejected records, but it generates no warnings.
It just shows a Info message:
"ORA_TABLE,0: Records inserted: 0
Records used for update: 0
Records rejected: 1
Total records: 1."

I guess this is a normal behaviour for DS but I would like to be warned when this happens!
I whish it would be as simple as setting a variable (like APT_IMPORT_REJECT_STRING_FIELD_OVERRUNS for string truncation) where we could say "DS, please warn me when there are rejected rows".
From your experience what solutions can I try?

Thanks in advance!
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Honestly, the best defense is a good offense. Make sure you don't generate those errors. Failing that, check the log 'after job' for messages like that and alert there.
-craig

"You can never have too many knives" -- Logan Nine Fingers
cppwiz
Participant
Posts: 135
Joined: Tue Sep 04, 2007 11:27 am

Post by cppwiz »

1. Send the upsert rejects to a file
2. Run a shell script to count the lines in the file
3. Send an email if the count > 0
pnpmarques
Participant
Posts: 35
Joined: Wed Jun 15, 2005 9:27 am

Oracle Connector

Post by pnpmarques »

Solution: no more oracle enterprise stage, from now on I'll just use Oracle Connector stage.
Post Reply