File format issue

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
balu536
Premium Member
Premium Member
Posts: 103
Joined: Tue Dec 02, 2008 5:01 am

File format issue

Post by balu536 »

Hi,
I need to extract data from a source file. Format of the file is as below

COLUMN - A|B|C|D|E
ROW1 - 45|56|67|23A||
ROW2 - 45|56|67|23A||
ROW3 - 45|56|67|23A|Sam
ROW4 - 45|56|67|23A|Martin
ROW5 - 45|56|67|23A|Sunny
ROW6 - 45|56|67|23A|Keaubu

I'm using Sequential file stage to extract the data and below are the properties set in the Format tab of the Sequential file stage.

Record level
Final delimiter :end
Record delimiter :UNIX newline

Field defaults
Delimiter :'|'
Null field value = ''
Quote = none


With these settings, I'm able to read the data but the last column has '|' value for ROWS 1&2.

**************************
If I change the settings as below

Record level
Final delimiter :'|'
Record delimiter :UNIX newline

Field defaults
Delimiter :'|'
Null field value = ''
Quote = none

ROWS 3,4,5,6 are dropped with warning "Delimiter for field not found"
**************************

Please guide me on how to solve this issue.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Get rid of the Final Delimiter property. This asserts that there is an extra delimiter character between the last field and the end of the record, which is not the case in your data.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply