Page 1 of 1

Schema File

Posted: Tue Feb 28, 2012 9:57 am
by Nagac
Hi,

I have Common Job which extracts the data from multiple files with n number of fields. In Job, we use Column Import Stage with Schema File to import into multiple fields as we initially read file as single field.

When we do testing we send more no. of delimiters(|) than expected(Eg: we have two fields, but we send 5 delimiters. We expect it should reject the row but it has sent the rows to output with
Col1, Col2
Value1,|||||

Thanks

Posted: Tue Feb 28, 2012 3:10 pm
by Kryt0n
From what little I can remember, the last column consumes until the record delimiter (or its width if happens first).

Use a transformer prior to import stage and count the number of delimiters

Posted: Wed Feb 29, 2012 5:03 am
by Nagac
Thanks Kryt0n, i thought there will be solution in Schema File.