Strange warning from a sequential file load

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
abc123
Premium Member
Premium Member
Posts: 605
Joined: Fri Aug 25, 2006 8:24 am

Strange warning from a sequential file load

Post by abc123 »

I have a very simple job with source and target sequential file stages.
I have a 100 character Unix file with just 1 line. The columns are:

A 10
B 10
C 50
D 30

On the Format tab of the source sequential file stage, I have:

Record Level:
Final Delimiter: None
Record Deliiter: UNIX Newline

Field Defaults:
Delimiter = none

Whenever I run the job, I keep getting the warning:

Import consumed only 80bytes of the record's 101 bytes (no further warnings will be generated from this partition)

Any ideas?
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

It looks like you declared 4 columns at 20bytes apiece in your metadata for the fixed width, and this is incorrect and being flagged by DS.
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

don't specify lenth for the last field, and the result
abc123
Premium Member
Premium Member
Posts: 605
Joined: Fri Aug 25, 2006 8:24 am

Post by abc123 »

I found the reason and it is definitely a strange one. On the columns tab of the sequential file stage, I rightclicked and added Field Properties. This opens the Edit Column Meta Data window. On this window, the Field Width property for the last column is 10 eventhough on the Columns tab, I specified the length as 30 (this column initially had a length of 10). Apparently, this overrides the length specified. Very strange!
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The Field Width property is the Display Size, not the SQL precision.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
abc123
Premium Member
Premium Member
Posts: 605
Joined: Fri Aug 25, 2006 8:24 am

Post by abc123 »

If Field Width for display size, why do I get the error message then? It overrides the value specified in the Length column. Where would I set the SQL precision, i.e., where does Datastage read the actual value of the column size from?
Post Reply