Read sequential file with ^M in record
Posted: Wed Jan 13, 2010 8:12 am
Hi all,
I have a request in which we need to process a file deliverd by business (CSV).
I've configured the sequential file stage to "Record delimiter string: DOS" , and the section Field Defaults: "Delimiter= |"
The problem is that the column "process" can have a carriage return, and they also want to see this carriage return in the database to which we need to upload the file.
Example of the file record:
"<NULL>"|"<NULL>"|"False"|"12:00 u"|"<NULL>"|"Access"|"Tabel: Pakketten Sales per channel^M
Excel: C+ migraties in input sheet IDTV"|"<NULL>"|"
In vi i can see that there is also a ^M present in the column itself. I've tried different settings but the record is always send to the reject link with following warning:
Sequential_File_0,0: Input buffer overrun at field "Process"
My question is: Is the sequential file stage able to read records where a column in the file contains a carriage return ? And if so, what settings do you need to use in the stage ?
Thanks for any info you can provide.
I have a request in which we need to process a file deliverd by business (CSV).
I've configured the sequential file stage to "Record delimiter string: DOS" , and the section Field Defaults: "Delimiter= |"
The problem is that the column "process" can have a carriage return, and they also want to see this carriage return in the database to which we need to upload the file.
Example of the file record:
"<NULL>"|"<NULL>"|"False"|"12:00 u"|"<NULL>"|"Access"|"Tabel: Pakketten Sales per channel^M
Excel: C+ migraties in input sheet IDTV"|"<NULL>"|"
In vi i can see that there is also a ^M present in the column itself. I've tried different settings but the record is always send to the reject link with following warning:
Sequential_File_0,0: Input buffer overrun at field "Process"
My question is: Is the sequential file stage able to read records where a column in the file contains a carriage return ? And if so, what settings do you need to use in the stage ?
Thanks for any info you can provide.