Handling Data in Sequentail file

srai · Post by **srai** » Mon Jul 12, 2010 1:33 am

Hi All,

We facing one data related issues while loading data from Sequential file to Database.

Jobs design is like

Seq File------------>Target db(Oracle)

We are geting records like

1) "364237",5/31/2010 0:00:00,"PERIMETER CENTER LOFTS LLC","00001316","CRE"

Above mentioned is correct record and working fine.

2) "373466",5/31/2010 0:00:00,"PLAZA 111

(CARDINAL REAL ESTATE INVESTMENTS)","00000941","CRE"

this one is not proper record because there is one additional line in cloumn three and due to which job fails. We want to reject that record and make the job work.

ray.wurlod · Post by **ray.wurlod** » Mon Jul 12, 2010 1:53 am

Scroll right in the Columns grid and you will find a property called something like "field contains terminators". Set this to true and your problem will vanish, provided that string fields are all correctly quoted.

chulett · Post by **chulett** » Mon Jul 12, 2010 6:10 am

However, it will then read the record, not reject it. You then have to decide what to do (if anything) with the CR/LF in the data.

laknar · Post by **laknar** » Mon Jul 12, 2010 9:46 am

Read entire row as single column.
Have a transformer between Sequential File and Database Stage.
Check the number of fields in Transformer Stage Variable. If it is less then what you are expecting then reject by using constraint.