Data Validation/Rejection

vnotz · Post by **vnotz** » Tue Mar 12, 2013 12:24 am

Hi All,

We want to implement a generic data validation for things like data length, data type, decimal places etc and capture the reject records in a separate file for audit purpose. Doing this separately for each and every field in a transformer stage is one way. But is there any other way or stage that can be used to do this in a much more simpler way?

Thanks in advance for your help.

ray.wurlod · Post by **ray.wurlod** » Tue Mar 12, 2013 2:00 am

Welcome aboard.

The Transformer stage is probably the simplest way.

If you have an Information Analyzer licence you could also use the Data Rules stage in DataStage.

prasannakumarkk · Post by **prasannakumarkk** » Tue Mar 12, 2013 3:10 am

Hi Ray,

Do you have any links that best explains the Data Rules stage

stuartjvnorton · Post by **stuartjvnorton** » Tue Mar 12, 2013 6:25 am

Look for it in the Information Analyzer User Guide.

You want to generically evaluate whether source data satisfies target metadata restrictions?

chulett · Post by **chulett** » Tue Mar 12, 2013 7:23 am

Here for one.

Doesn't really seem like a QualityStage question, does this need to be moved?

ray.wurlod · Post by **ray.wurlod** » Tue Mar 12, 2013 3:05 pm

While it's a data quality question, it's not a QualityStage question. However, it's a mixed DataStage/IA question, so General is probably the best forum.

chulett · Post by **chulett** » Tue Mar 12, 2013 3:24 pm

So let it be written, so let it be done.

vnotz · Post by **vnotz** » Tue Mar 12, 2013 11:00 pm

Thanks Ray for your advice!