Page 1 of 1

Transfomer dropping row

Posted: Thu Oct 27, 2011 1:29 pm
by Rajav123
Transfomer is dropping a record when the field has null.

DB --> Xfm-->Lookup-->xfm2..>file

Source has 15 rows. One of the columns in source doesn't have lookup value in lookup table. so it is passed out of Lookup stage.(15 rows) with NULL value. When data passing out of xfm2, only 14 rows are passed out. I tried with putting all columns Nullable to 'YES'. But still I am not able to get through all 15 rows. The row with NULL value is getting dropped out after xfm2. In xfm2, I put
if IsNull(lnk_order.ID) then '' else lnk_order.ID

Posted: Thu Oct 27, 2011 2:56 pm
by ray.wurlod
Is the "Lookup failed" rule in your Lookup stage "Drop"?

Posted: Thu Oct 27, 2011 5:49 pm
by prakashdasika
Are you using any stage variable that has the column mentioned. Stage variables cannot handle null. I would say use NullToEmpty or NullToValue functions for handling nulls.

Posted: Thu Oct 27, 2011 9:28 pm
by jwiles
In addition, not only within a stage variable derivation but if you reference the column in the derivation of another output column. If you do anything with a nullable column other than simply copy it to an output link you need to include null handling logic.

Regards,

Posted: Sun Oct 30, 2011 8:28 am
by fmou
Rajav,

Please mark the topic as resolve if it is.

I believe all cases have been covered in above replies.