Validation with log for each record

[myukassign]

Hi I have a situation where I would like to get some ideas to crack.

id, sales_date, desc, qty

1,'2008-10-9','suzki',100
1,'2008-10-9','mitsu',100
1,'2008-10-9','jaugur',100
1,'2008-10-9','aston',100

The requirement is to validate the format of each record and datatype of each record and if it did not match with the requirement for each record it should write a flag in the log file. It should do this validation for all records. Please tell me whats the best approach.

e.g.

if the first record was like this, one column is missing, it should write a log
1,'2008-10-9','suzki'

or if it is like this, one extra column...still it should write to a log file(txt file)

1,'2008-10-9','suzki',100, 'aaa'

or if it is like this , third field is not varchar, still should log

1,'2008-10-9',0000,100

any help the best method to do it....

[ray.wurlod]

Do it all in a Transformer stage with a second output (or more than one) for the log. Make use of stage variables for decision making.

[chulett]

You might want to flag each record with the validation error(s) that caused the reject, unless you don't mind figuring it out all over again later.

[myukassign]

In my case...

I want to check if it the incoming value is interger or not , float or not, etc...


I browse through the functions availabe and I couldn't see any function that check the data type of a field and return True or flase...

pls help

[nitkuar]

Try IsValid function