Page 1 of 2

Read_delimited()- Required Column Missing

Posted: Thu Nov 02, 2006 1:47 pm
by shilpa79
Untitled1..Sequential_File_5.DSLink6: read_delimited() - row 5, column Field015, required column missing

I am getting this error while loading from sequential file to Oracle table.
Could you please let me know which is the best way to solve this issue.

Shilpa.

Posted: Thu Nov 02, 2006 1:52 pm
by ray.wurlod
Before we do that, please summarize what information you have actually gotten from the message.

For example, I can discern that you get this message using View Data when still designing the job. I can discern much more. But we need to know how good your diagnostic skills are.

Philosophy Corner
If you give a man a fish you assuage his hunger for a day. If you teach a man to fish, that is a more permanent solution.

Posted: Thu Nov 02, 2006 2:08 pm
by shilpa79
Yes, I got this message when I view the seq file.

for eg:
The input record:
470E|hyd 3721|hyd! Consolidated||Intl||sar||North Asia||||Total ind||470E|ap! 3721

And total we have 16fields and in the file we are not getting all the colums for all the records.

Shilpa.

Posted: Thu Nov 02, 2006 2:11 pm
by dsscholar
Have you set the delimiter as '|', by deafault it is set be a comma(,) ?

Posted: Thu Nov 02, 2006 2:14 pm
by shilpa79
Yes, I did

Shilpa.

Posted: Thu Nov 02, 2006 2:30 pm
by samsuf2002
how many columns r u getting while importing meta data

Posted: Thu Nov 02, 2006 2:32 pm
by thumsup9
If you want to get fewer columns that the 16 fields that exisit in the data then you will get this read delimited, may be you should check the box for Suppress Row Truncation Warnings..

Posted: Thu Nov 02, 2006 2:57 pm
by shilpa79
16 columns

Posted: Thu Nov 02, 2006 2:58 pm
by gateleys
Make sure you have the right metadata. If the sequential file is a result of some other process, save the metadata (where the sequential file consumes the output) and load it in the load-job.

gateleys

Posted: Thu Nov 02, 2006 2:59 pm
by shilpa79
I donot see any truncation warnings...........

Posted: Thu Nov 02, 2006 3:04 pm
by samsuf2002
it is likely to be bad data what is the format u r giving in seq file

Posted: Thu Nov 02, 2006 3:19 pm
by ray.wurlod
You don't seem to have gotten much out of the message.

Which line in the file should you be looking at?
What should you be looking for it there?
How is NULL represented in this file?
What property of the link should you be changing to address this issue (the issue of missing column)?

Posted: Thu Nov 02, 2006 3:22 pm
by shilpa79
Basically the problem is the first record has 16columns , the second record has 12 columns the last four colums of the second record need to be loaded as empty.However there are no pipes delimiting these empty fields.And there is also no row delimeted.
My question is how do you import the data with variable columns, if seq.file stage is not the correct one then what should be used.
I tried using a folder stage it doesnot work.

For eg:
1 record:470E|Hyd! 3721|Hyd! Consolidated||Intl||Asia Pacific||North Asia||Total China w/ JV||Total China||470E|Hyd! 3721

2 record:470E|Hyd! 3721|Hyd! Consolidated||Intl||Asia Pacific||North Asia||Total China w/ JV

Shilpa.

Posted: Thu Nov 02, 2006 3:24 pm
by DeepakCorning
1. Open the File in a notepad. Remove the Word Wrap.
2. Press Ctrl+G.
3. Go to the line number specified in the Message.
4. Check out if it has 16 columns or not. If yes , check the immediate next or previous line.

:D

Posted: Thu Nov 02, 2006 3:27 pm
by DeepakCorning
shilpa79 wrote: My question is how do you import the data with variable columns, if seq.file stage is not the correct one
Shilpa.
two things you can do --

1. Import this file in Access and Export it back in a new file with whatever delimiter you want.
2. Or try to use it as a fixed length file. Reading the Rows as a single row and single column.

But the question that arises is if the columns are variable how are you going to define the mapping in the next stages?? The program has to be intelligent enough to do that for you. :wink: