Page 1 of 1

Data Validation/Rejection

Posted: Tue Mar 12, 2013 12:24 am
by vnotz
Hi All,

We want to implement a generic data validation for things like data length, data type, decimal places etc and capture the reject records in a separate file for audit purpose. Doing this separately for each and every field in a transformer stage is one way. But is there any other way or stage that can be used to do this in a much more simpler way?

Thanks in advance for your help.

Posted: Tue Mar 12, 2013 2:00 am
by ray.wurlod
Welcome aboard.

The Transformer stage is probably the simplest way.

If you have an Information Analyzer licence you could also use the Data Rules stage in DataStage.

Posted: Tue Mar 12, 2013 3:10 am
by prasannakumarkk
Hi Ray,

Do you have any links that best explains the Data Rules stage

Posted: Tue Mar 12, 2013 6:25 am
by stuartjvnorton
Look for it in the Information Analyzer User Guide.

You want to generically evaluate whether source data satisfies target metadata restrictions?

Posted: Tue Mar 12, 2013 7:23 am
by chulett
Here for one.

Doesn't really seem like a QualityStage question, does this need to be moved?

Posted: Tue Mar 12, 2013 3:05 pm
by ray.wurlod
While it's a data quality question, it's not a QualityStage question. However, it's a mixed DataStage/IA question, so General is probably the best forum.

Posted: Tue Mar 12, 2013 3:24 pm
by chulett
So let it be written, so let it be done. :wink:

Posted: Tue Mar 12, 2013 11:00 pm
by vnotz
Thanks Ray for your advice!