Page 1 of 1

Rejects from Modify

Posted: Tue Dec 22, 2009 10:13 am
by kishorenvkb
Hello All,

Are rejects possibile using the Modify stage? I am planning to convert the columns from string to integer using the modify stage and I wanted all the rows that fail to convert go into a reject file.

Please assist

Kishore

Posted: Tue Dec 22, 2009 10:21 am
by chulett
I don't believe so. Check upstream using the IsValid function and reject them before the Modify.

Posted: Tue Dec 22, 2009 10:33 am
by kishorenvkb
Thanks Chulett.

You are suggesting to use the IsValid function in the Transformer, right? I was trying to avoid transformer for the performance reasons.

or the Transformer isn't that bad for this functionality? I am expecting about 500 million records as input.

Thanks

Posted: Tue Dec 22, 2009 10:35 am
by chulett
Yes, in a transformer. And there's no reason to avoid the transformer for "performance reasons", those days are long ago.