Reading Multiple Flat Files with Headers using File Pattern
Posted: Wed May 16, 2012 2:29 am
Hi,
I am posed with an elementary level issue. The requirement is to read multiple files with similar schemas and load into a table. The problem is that each of these files have column names as header.
When I try reading all the files of a specific pattern using the 'FILE PATTERN' property in the Sequential File stage, all but the header of the first file appear as part of the data. The data looks something like
a,b,c,d,e
c,v,b,n,n
COL1,COL2,COL3,COL4,COL5
a,d,g,h,s
COL1,COL2,COL3,COL4,COL5
a,c,v,b,n
q,e,w,q,s
The 'First Name iS Column Name' property has been set to true. I want the data to be read without the column names
I am posed with an elementary level issue. The requirement is to read multiple files with similar schemas and load into a table. The problem is that each of these files have column names as header.
When I try reading all the files of a specific pattern using the 'FILE PATTERN' property in the Sequential File stage, all but the header of the first file appear as part of the data. The data looks something like
a,b,c,d,e
c,v,b,n,n
COL1,COL2,COL3,COL4,COL5
a,d,g,h,s
COL1,COL2,COL3,COL4,COL5
a,c,v,b,n
q,e,w,q,s
The 'First Name iS Column Name' property has been set to true. I want the data to be read without the column names