problem with fixed width file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sravanthi
Participant
Posts: 83
Joined: Fri Jun 02, 2006 5:37 am

problem with fixed width file

Post by sravanthi »

Hi,

I'm reading fixed width file.I used record length is Fixed and delimiter none.And Packed as no(overpunch).

For all decimal fields i have mentioned field width by editing the row.

I'm not able to view the whole data.Some of the records are getting rejected when i run the job.

Sample of the data inserted into output is :

2433944000 40654016500 40654016500 K020071025001077001200710152007100120071001P12HOME HEALTH AZDURABLE MEDICAL EQUIPMENT SUPPLY SRSELF REFERRED PPPARTICIPATING PROVIDER E0570 RR NEBULIZER, WITH COMPRESSOR 496 CHRONIC AIRWAY OBSTRUCTION, NOT ELSEWHERE CLASSIFI 00000000000000000 00001000000100000010000000002700000000000000000000016590000000000033200000000000332000000000000000000000000000000000000000000000000000000000000000000132700000000000000000033200000000000000000000000000000332000001327000000000 0000000006420071031LTOFACILITY LESSER THAN LOGIC CHG000000 000000000000000000 0000100000000000000000000000000000000Y 00000000000000002433944000 000000000000 00000000000000 000002700000000000000001659000000000000002368000001327000000000000001327000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001041000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001689656381


And rejected record :

0810586000 20148524300 20148524300 1A20071023003025003200710152007101220071012P11OFFICE VISIT BPINJECTION OF MATERIAL PCPCP PROVIDER PBPREMIER BLUE NETWORK PROVIDER NPNON-PARTICIPATING PROVIDER 90658 INFLUENZA VIRUS VACCINE, SPLIT VIRUS, WHEN ADMINIS V04.81 NEED FOR PROPHYLACTIC VACATION AND INOCULATION, 00000000000000000 00001000000100000010000000002000000000000000000000016900000000000000000000000000000000000000000000000000000000000000000000000000000000000000169000000169000000000000000000000000000000000000000000000000000000000001690000000000 0310158673420071031BASBASE CALC - TS2 000000 000000000000000000 0000000000000000000000000000000000000 00000000000000000810586000 000000000000 00000000000000 000002000000000000000001690000000000000002000000001690000000000000001690000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000310000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001336341460

The warning in the director is :

Input buffer overrun at field "FIELD", at offset: 1,573.

This is the last column in the record.The input file is ftped from Mainframe.

Please advice!

Thanks,
sravanthi
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

What is your column "FIELD" declared as? Do you get the buffer overrun error on several rows, or perhaps just the last row in the file?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Where do you get your metadata? Ask the mainframe folks for the COBOL file definition, and import the table definition from that. At the very least it ought to match the data you are receiving. Then you might contemplate using either a Sequential File stage with fixed-width format, or perhaps a Complex Flat File stage, to parse the records. You also have to specify, in either case, that there is no line terminator (record delimiter).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
sravanthi
Participant
Posts: 83
Joined: Fri Jun 02, 2006 5:37 am

Post by sravanthi »

The column FIELD is declared as char(10).I have got the buffer overrun on several rows.

I have got table definition from database which send the data to Mainframe.I'm using the files ftped from Mainframe.


Please advice!

Thanks!
sravanthi
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Review the manual's section on importing table definition for fixed-width files. The total number of characters in the metadata must exactly match the total number of characters in the data record.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply