Read_delimited()- Required Column Missing

[shilpa79]

Untitled1..Sequential_File_5.DSLink6: read_delimited() - row 5, column Field015, required column missing

I am getting this error while loading from sequential file to Oracle table.
Could you please let me know which is the best way to solve this issue.

Shilpa.

[ray.wurlod]

Before we do that, please summarize what information you have actually gotten from the message.

For example, I can discern that you get this message using View Data when still designing the job. I can discern much more. But we need to know how good your diagnostic skills are.

Philosophy Corner
If you give a man a fish you assuage his hunger for a day. If you teach a man to fish, that is a more permanent solution.

[shilpa79]

Yes, I got this message when I view the seq file.

for eg:
The input record:
470E|hyd 3721|hyd! Consolidated||Intl||sar||North Asia||||Total ind||470E|ap! 3721

And total we have 16fields and in the file we are not getting all the colums for all the records.

Shilpa.

[dsscholar]

Have you set the delimiter as '|', by deafault it is set be a comma(,) ?

[shilpa79]

Yes, I did

Shilpa.

[samsuf2002]

how many columns r u getting while importing meta data

[thumsup9]

If you want to get fewer columns that the 16 fields that exisit in the data then you will get this read delimited, may be you should check the box for Suppress Row Truncation Warnings..

[shilpa79]

16 columns

[gateleys]

Make sure you have the right metadata. If the sequential file is a result of some other process, save the metadata (where the sequential file consumes the output) and load it in the load-job.

gateleys

[shilpa79]

I donot see any truncation warnings...........

[samsuf2002]

it is likely to be bad data what is the format u r giving in seq file

[ray.wurlod]

You don't seem to have gotten much out of the message.

Which line in the file should you be looking at?
What should you be looking for it there?
How is NULL represented in this file?
What property of the link should you be changing to address this issue (the issue of missing column)?

[shilpa79]

Basically the problem is the first record has 16columns , the second record has 12 columns the last four colums of the second record need to be loaded as empty.However there are no pipes delimiting these empty fields.And there is also no row delimeted.
My question is how do you import the data with variable columns, if seq.file stage is not the correct one then what should be used.
I tried using a folder stage it doesnot work.

For eg:
1 record:470E|Hyd! 3721|Hyd! Consolidated||Intl||Asia Pacific||North Asia||Total China w/ JV||Total China||470E|Hyd! 3721

2 record:470E|Hyd! 3721|Hyd! Consolidated||Intl||Asia Pacific||North Asia||Total China w/ JV

Shilpa.

[DeepakCorning]

1. Open the File in a notepad. Remove the Word Wrap.
2. Press Ctrl+G.
3. Go to the line number specified in the Message.
4. Check out if it has 16 columns or not. If yes , check the immediate next or previous line.

:D

[DeepakCorning]

My question is how do you import the data with variable columns, if seq.file stage is not the correct one
Shilpa.

two things you can do --

1. Import this file in Access and Export it back in a new file with whatever delimiter you want.
2. Or try to use it as a fixed length file. Reading the Rows as a single row and single column.

But the question that arises is if the columns are variable how are you going to define the mapping in the next stages?? The program has to be intelligent enough to do that for you.