Rejects from Modify

kishorenvkb · Post by **kishorenvkb** » Tue Dec 22, 2009 10:13 am

Hello All,

Are rejects possibile using the Modify stage? I am planning to convert the columns from string to integer using the modify stage and I wanted all the rows that fail to convert go into a reject file.

Please assist

Kishore

chulett · Post by **chulett** » Tue Dec 22, 2009 10:21 am

I don't believe so. Check upstream using the IsValid function and reject them before the Modify.

kishorenvkb · Post by **kishorenvkb** » Tue Dec 22, 2009 10:33 am

Thanks Chulett.

You are suggesting to use the IsValid function in the Transformer, right? I was trying to avoid transformer for the performance reasons.

or the Transformer isn't that bad for this functionality? I am expecting about 500 million records as input.

Thanks

chulett · Post by **chulett** » Tue Dec 22, 2009 10:35 am

Yes, in a transformer. And there's no reason to avoid the transformer for "performance reasons", those days are long ago.