Page 1 of 1
records dropping in transformer!!
Posted: Tue Sep 13, 2011 11:49 am
by kennyapril
There were around 5 jobs which has no dropped records and all the fileds have been given NVL in the source query. All the jobs were running fine.
All of a sudden the records are getting dropped in the transformer stage which is between two lookups for all the 5 jobs.
please suggest me if I need to change anything
Thanks
Posted: Tue Sep 13, 2011 12:01 pm
by kommven
In Lookup Stage(s), Change Lookup condition from Drop to Continue.
I suspect a lookup failure is causing a drop.
You can enable/use "reject" in Lookup to capture/identify what are failing...
New rows in source are having values that are not there in lookup?
Posted: Tue Sep 13, 2011 12:24 pm
by kennyapril
Actually all the lookups have continue and I am capturing the rejects at the end of the job by filtering the '0' values.
The only thing is usually if a lookup failure occurs the value '0' is given when continue is used, but in this situation the records are dropping.
Posted: Tue Sep 13, 2011 12:32 pm
by kennyapril
Actually all the lookups have continue and I am capturing the rejects at the end of the job by filtering the '0' values.
The only thing is usually if a lookup failure occurs the value '0' is given when continue is used, but in this situation the records are dropping.