Error reading sequentail file

[sshettar]

Hi All,

I have this error reading a sequential file due to which 4 records are being rejected due to following errors.
Input buffer over run and import error and no default value



i did output the error to a peek stage and also did a search on both the errors and did learn that for input buffer over run either the null value for the column should be defined or should try reading the field as varchar.
the error i got was
Input buffer overrun at field "XXX", at offset: 209

well the null field value is defined in the sequentail file and also i did change the field from char to varchar

when i did that i now get the error for the same field as Delimiter for field "XXX" not found; input: {L R G 0d}, at offset: 209

For a different field which happens to be a primary key ( as in this field cannot be null ) i get the error as

rejected:{2 0 7 7 4 4 | ~ 1 0 | ~ 1 9 | ~ 2 0 0 9 - 1 2 - 0 9 | ~ | ~ 20 | ~ 8 8 1 | ~ 1 5 | ~ 5 9 | ~ 20 0 0 0 1 6 5 6 . | ~ 20 0 0 0 0 0 0 0 . | ~ 20 0 0 0 0 0 0 0 . | ~ C 0 0 2 | ~ 3 | ~ U S A | ~ 20 20 20 | ~ 20 20 20 20 | ~ 20 | ~ 20 0 0 0 . | ~ G | ~ 2 0 0 9 - 1 2 - 0 9 | ~ 2 0 0 9 - 1 2 - 1 0 | ~ 2 0 0 9 - 1 2 - 1 7 | ~ 2 0 0 9 - 1 2 - 2 4 | ~ 2 0 1 0 - 0 1 - 0 4 | ~ 2 0 1 0 | ~ 1 | ~ 0 | ~ 0 | ~ N | ~ S | ~ C | ~ 20 20 20 | ~ C | ~ L R G 0d}

"YYYYYY" has import error and no default value; data: {L R G 20 20 20 20 20 20 20}, at offset: 0

rejected:{L R G 20 20 20 20 20 20 20 | ~ 0 | ~ 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ | ~ 1 9 0 0 - 0 1 - 0 1 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . | ~ 20 0 0 0 0 0 0 0 . | ~ 1 9 0 0 - 0 1 - 0 1 | ~ | ~ G | ~ 1 9 0 0 - 0 1 - 0 1 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 . 0 0 | ~ 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ | ~ N | ~ N | ~ N | ~ N | ~ N | ~ N | ~ Y | ~ Y | ~ N | ~ N | ~ N | ~ N | ~ N | ~ N | ~ 1 9 0 0 - 0 1 - 0 1 | ~ 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 7 | ~ 20 | ~ M E G A 20 B & M 00 00 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . | ~ 00 00 00 | ~ 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ T I G E R 20 A P P A R E L 20 C O R P 20 20 20 20 20 20 20 20 20 20 20 20 | ~ J U N I O R S 20 U R B A N 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 20 | ~ M A N Y | ~ Y | ~ 0 | ~ | ~ 20 0 0 0 0 0 0 0 2 2 . 9 8 | ~ 20 0 0 0 0 3 0 3 4 0 . | ~ 2 0 1 0 - 0 5 - 2 8 20 1 3 : 2 0 : 1 5 | ~ 2 0 1 0 - 0 5 - 2 8 20 1 3 : 2 0 : 1 5 | ~ 5 7 4 9 8 9 2 | ~ 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 20 0 0 0 0 0 0 0 0 0 0 . | ~ 20 0 0 0 0 0 0 0 0 0 0 . | ~ 20 0 0 0 0 0 0 0 0 0 0 . | ~ N / A 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ N | ~ N | ~ N | ~ 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 | ~ 20 20 20 | ~ N | ~ 0 | ~ 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 | ~ C A | ~ 0 0 0 0 0 20 20 20 20 20 | ~ 7 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 20 0 0 . 0 | ~ N | ~ 0 0 0 1 - 0 1 - 0 1 | ~ 2 | ~ 20 0 0 0 0 0 1 8 8 1 . 0 0 | ~ 20 0 0 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 1 8 8 1 . 0 0 | ~ 20 0 0 0 0 0 4 5 5 0 . 0 4 | ~ 2 0 1 0 - 0 1 - 0 8 | ~ 20 0 6 0 . | ~ V | ~ N | ~ N | ~ N}



As this field cannot be null ( cause this file is being created in another datastage job where it is pulling this field from a table, where in this field is a primary key).Even ptherwise the null field value is being defined in the sequential file too, but still i get the above error

Any help on this is highly appreciated.

Thanks in advance

[chowdhury99]

Just after the following warning:
Input buffer overrun at field "XXX", at offset: 209

there could be the "Import warning at record ---". Check the source file and check that record. Certainly the length of that record is not in correct size.

Thanks.

Hi All,

I have this error reading a sequential file due to which 4 records are being rejected due to following errors.
Input buffer over run and import error and no default value



i did output the error to a peek stage and also did a search on both the errors and did learn that for input buffer over run either the null value for the column should be defined or should try reading the field as varchar.
the error i got was
Input buffer overrun at field "XXX", at offset: 209

well the null field value is defined in the sequentail file and also i did change the field from char to varchar

when i did that i now get the error for the same field as Delimiter for field "XXX" not found; input: {L R G 0d}, at offset: 209

For a different field which happens to be a primary key ( as in this field cannot be null ) i get the error as

rejected:{2 0 7 7 4 4 | ~ 1 0 | ~ 1 9 | ~ 2 0 0 9 - 1 2 - 0 9 | ~ | ~ 20 | ~ 8 8 1 | ~ 1 5 | ~ 5 9 | ~ 20 0 0 0 1 6 5 6 . | ~ 20 0 0 0 0 0 0 0 . | ~ 20 0 0 0 0 0 0 0 . | ~ C 0 0 2 | ~ 3 | ~ U S A | ~ 20 20 20 | ~ 20 20 20 20 | ~ 20 | ~ 20 0 0 0 . | ~ G | ~ 2 0 0 9 - 1 2 - 0 9 | ~ 2 0 0 9 - 1 2 - 1 0 | ~ 2 0 0 9 - 1 2 - 1 7 | ~ 2 0 0 9 - 1 2 - 2 4 | ~ 2 0 1 0 - 0 1 - 0 4 | ~ 2 0 1 0 | ~ 1 | ~ 0 | ~ 0 | ~ N | ~ S | ~ C | ~ 20 20 20 | ~ C | ~ L R G 0d}

"YYYYYY" has import error and no default value; data: {L R G 20 20 20 20 20 20 20}, at offset: 0

rejected:{L R G 20 20 20 20 20 20 20 | ~ 0 | ~ 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ | ~ 1 9 0 0 - 0 1 - 0 1 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . | ~ 20 0 0 0 0 0 0 0 . | ~ 1 9 0 0 - 0 1 - 0 1 | ~ | ~ G | ~ 1 9 0 0 - 0 1 - 0 1 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 . 0 0 | ~ 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ | ~ N | ~ N | ~ N | ~ N | ~ N | ~ N | ~ Y | ~ Y | ~ N | ~ N | ~ N | ~ N | ~ N | ~ N | ~ 1 9 0 0 - 0 1 - 0 1 | ~ 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 7 | ~ 20 | ~ M E G A 20 B & M 00 00 | ~ 20 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 . | ~ 00 00 00 | ~ 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ T I G E R 20 A P P A R E L 20 C O R P 20 20 20 20 20 20 20 20 20 20 20 20 | ~ J U N I O R S 20 U R B A N 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 20 | ~ M A N Y | ~ Y | ~ 0 | ~ | ~ 20 0 0 0 0 0 0 0 2 2 . 9 8 | ~ 20 0 0 0 0 3 0 3 4 0 . | ~ 2 0 1 0 - 0 5 - 2 8 20 1 3 : 2 0 : 1 5 | ~ 2 0 1 0 - 0 5 - 2 8 20 1 3 : 2 0 : 1 5 | ~ 5 7 4 9 8 9 2 | ~ 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 20 0 0 0 0 0 0 0 0 0 0 . | ~ 20 0 0 0 0 0 0 0 0 0 0 . | ~ 20 0 0 0 0 0 0 0 0 0 0 . | ~ N / A 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ N | ~ N | ~ N | ~ 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 | ~ 20 20 20 | ~ N | ~ 0 | ~ 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 | ~ C A | ~ 0 0 0 0 0 20 20 20 20 20 | ~ 7 | ~ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ~ 20 0 0 . 0 | ~ N | ~ 0 0 0 1 - 0 1 - 0 1 | ~ 2 | ~ 20 0 0 0 0 0 1 8 8 1 . 0 0 | ~ 20 0 0 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 0 0 0 0 . 0 0 | ~ 20 0 0 0 0 0 1 8 8 1 . 0 0 | ~ 20 0 0 0 0 0 4 5 5 0 . 0 4 | ~ 2 0 1 0 - 0 1 - 0 8 | ~ 20 0 6 0 . | ~ V | ~ N | ~ N | ~ N}



As this field cannot be null ( cause this file is being created in another datastage job where it is pulling this field from a table, where in this field is a primary key).Even ptherwise the null field value is being defined in the sequential file too, but still i get the above error

Any help on this is highly appreciated.

Thanks in advance

[ray.wurlod]

Check your metadata. What is the data type of the first column? What is the field delimiter character?

[sshettar]

The datatype for the first column is SmallInt and the field delimiter for the file is |~

[ray.wurlod]

"LRG____" is not a SmallInt, which is why this row is rejected.