Page 1 of 1

Problem Reading Fixed width File

Posted: Tue Jun 26, 2007 12:05 pm
by umamahes
Hi,

I am getting the following warning when i tried to reqad fixed width file with ASCII characters

Capitationtest..Sequential_File_0.DSLink2: read_fixedwidth() - row 66, column WK_MEMBER_NUMBER, column unexpectedly ended by EOR

In the sequential stage if i use line termination none then only i am able to read this file.when i do wc -l on unix it is showing 7000 records but it has 1 million records actually.so what is the problem.IF i use none as line termination i am able to view the data with out any warning.When i run the job with this option i am getting the following error.

Capitationtest..Sequential_File_0.DSLink2: read_fixedwidth() - row 607678, column WK_CARRIER, column unexpectedly ended by EOR

Posted: Tue Jun 26, 2007 12:21 pm
by ray.wurlod
Is it possible that some of your data fields contain newline characters?

Posted: Tue Jun 26, 2007 1:56 pm
by umamahes
Some of the data fields are comp with ASCII values.

Even in unix if i issue head -1 Filename it is giving multiple records not a single record

Thanks

Posted: Tue Jun 26, 2007 2:14 pm
by chulett
In other words, yes. You'll need to enable the Contains Terminators option for those columns. Slide the Columns tab over the the right to see that particular option.

If you didn't have any data fields with newlines in them, then a "wc -l" for your file would return "1".

Re: Problem Reading Fixed width File

Posted: Wed Jun 27, 2007 5:00 am
by klsrao
It looks like you have 7000 line terminators only in your input file.

Re: Problem Reading Fixed width File

Posted: Wed Jun 27, 2007 5:00 am
by klsrao
It looks like you have 7000 line terminators only in your input file.

Posted: Wed Jun 27, 2007 5:02 am
by ray.wurlod
This could be a field called something like NOTES or COMMENTS - some freeform text field into which a user has typed Enter.

Re: Problem Reading Fixed width File

Posted: Wed Jun 27, 2007 5:03 am
by klsrao
It looks like you have only 7000 line terminators (^M) in your input file.
Try removing all line terminators (^M) in your input file and set Line terminator none.

Lakshmi Srinivas


umamahes wrote:Hi,

I am getting the following warning when i tried to reqad fixed width file with ASCII characters

Capitationtest..Sequential_File_0.DSLink2: read_fixedwidth() - row 66, column WK_MEMBER_NUMBER, column unexpectedly ended by EOR

In the sequential stage if i use line termination none then only i am able to read this file.when i do wc -l on unix it is showing 7000 records but it has 1 million records actually.so what is the problem.IF i use none as line termination i am able to view the data with out any warning.When i run the job with this option i am getting the following error.

Capitationtest..Sequential_File_0.DSLink2: read_fixedwidth() - row 607678, column WK_CARRIER, column unexpectedly ended by EOR