How to capture the file name and row number

syam · Post by **syam** » Thu Mar 08, 2007 10:42 pm

Hi All;

I am using the file pattern to read the source files.And during the rejection process i want to capture the row number and the file name into the error log table so that user can know which record is rejected and from which file in the file pattern is it rejected.
Thanks in advance

Thanks;
Syam.

ray.wurlod · Post by **ray.wurlod** » Thu Mar 08, 2007 11:57 pm

Not possible.

The reject link gets rows that do not match the defined metadata. You get the input row as a raw string, in one column. This is not negotiable.

There is a workaround, which is to read the file as a single VarChar column and parse it yourself in a Transformer stage. The Sequential File stage can add a File Name column. You could use a Filter command or stage variables to detemine the line number within the file. You may need to partition on File Name for the stage variable approach to work.

kumar_s · Post by **kumar_s** » Fri Mar 09, 2007 1:48 am

You can include RowNumberColumn in addition to FileNameColumn.

DSguru2B · Post by **DSguru2B** » Fri Mar 09, 2007 7:42 am

Can't the business go off of a key column in the record? If not then add a running number to your file pre-hand before processing.

ray.wurlod · Post by **ray.wurlod** » Fri Mar 09, 2007 8:13 am

Hi Mister Hasty. If the OP is using File Pattern this implies sequential files and this implies no key.

DSguru2B · Post by **DSguru2B** » Fri Mar 09, 2007 8:26 am

Agreed Ray ji. Hence, pre-process to attach a running number.

kumar_s · Post by **kumar_s** » Fri Mar 09, 2007 8:31 am

Wont it be simple to find the file name and row num directly using RowNumberColumn in addition to FileNameColumn rather than, Pre processing all the files and find the file names back with the help of running nubmer.

DSguru2B · Post by **DSguru2B** » Fri Mar 09, 2007 8:54 am

Yes it would be. But as we are all in the mode of suggestions, I threw my poll ticket in as well.