Different Delimiter In one record

praburaj · Post by **praburaj** » Tue Apr 12, 2011 4:50 am

Hi,

I have received different source file. In my source file has 6 columns. The records are in source file has different delimiter in all the columns. The records are like I mentioned below.

column1 column2 column3 column4 column5 column6
1001 |Josh,US*Toys 2011

For one record is having different delimiter. How can I view this file from sequential file stage and I don't know how to set the delimiter for this file.

Please guide me what kind of options I have to set in the sequential file to view the data.

How to achieve this problem.

ray.wurlod · Post by **ray.wurlod** » Tue Apr 12, 2011 5:05 am

Have the Sequential File stage read the file with each line being a single VarChar field, then parse that in a downstream Transformer stage.

(This is actually more efficient, as the parsing occurs in parallel rather than in sequential mode.)

praburaj · Post by **praburaj** » Tue Apr 12, 2011 5:23 am

ray.wurlod wrote:Have the Sequential File stage read the file with each line being a single VarChar field, then parse that in a downstream Transformer stage.

(This is actually more efficient, as the parsing occurs ...

Thanks for your reply ray. But what delimiter I have to put in the Delimiter section in sequential file stage?

mac4rfree85 · Post by **mac4rfree85** » Tue Apr 12, 2011 5:31 am

why dont you concantante the columns with the required delimiter in the transformer itself..

rohithmuthyala · Post by **rohithmuthyala** » Tue Apr 12, 2011 6:21 am

What Ray is suggesting is that to read the whole row as a single column defined as a varchar datatype..!
So here it doesn't matter what delimiter one specifies.

ray.wurlod · Post by **ray.wurlod** » Tue Apr 12, 2011 4:44 pm

Field delimiter should be none.

praburaj · Post by **praburaj** » Tue Apr 12, 2011 11:56 pm

Thanks to everyone. I loaded the data successfully in my target table.

Thanks Once Again. :D