Transfomer dropping row

Rajav123 · Post by **Rajav123** » Thu Oct 27, 2011 1:29 pm

Transfomer is dropping a record when the field has null.

DB --> Xfm-->Lookup-->xfm2..>file

Source has 15 rows. One of the columns in source doesn't have lookup value in lookup table. so it is passed out of Lookup stage.(15 rows) with NULL value. When data passing out of xfm2, only 14 rows are passed out. I tried with putting all columns Nullable to 'YES'. But still I am not able to get through all 15 rows. The row with NULL value is getting dropped out after xfm2. In xfm2, I put
if IsNull(lnk_order.ID) then '' else lnk_order.ID

ray.wurlod · Post by **ray.wurlod** » Thu Oct 27, 2011 2:56 pm

Is the "Lookup failed" rule in your Lookup stage "Drop"?

prakashdasika · Post by **prakashdasika** » Thu Oct 27, 2011 5:49 pm

Are you using any stage variable that has the column mentioned. Stage variables cannot handle null. I would say use NullToEmpty or NullToValue functions for handling nulls.

jwiles · Post by **jwiles** » Thu Oct 27, 2011 9:28 pm

In addition, not only within a stage variable derivation but if you reference the column in the derivation of another output column. If you do anything with a nullable column other than simply copy it to an output link you need to include null handling logic.

Regards,

fmou · Post by **fmou** » Sun Oct 30, 2011 8:28 am

Rajav,

Please mark the topic as resolve if it is.

I believe all cases have been covered in above replies.