Load multiple .csv files into a single .csv file

[BIuser]

Hi All

I have 16 .csv file which I have to laod from a Sequential file to another.

the format is as followa:-

SEQUENTIAL FILE(17 .csv files) ------>Transformer----------->Sequential file(1 big file)

Can anyone help

[Shadab_Farooque]

Are the Columns in the 17 csv files different or all have same columns.

[k1980pc]

Hi All

I have 16 .csv file which I have to laod from a Sequential file to another.

the format is as followa:-

SEQUENTIAL FILE(17 .csv files) ------>Transformer----------->Sequential file(1 big file)

Can anyone help

In your source sequential file stage, use *.csv [ or sufficiently narrow it down]. Change Read Method to "file pattern". Now handle it as if you got just one csv
DS will read the files in parallel mode - Multiple readers at same time but single reader per file ( since you have used file pattern)

PS : I assumed all those files have same format.

[chulett]

Start by asking a more specific question. What problem are you having?

If the metadata is identical across the files, why not just concatenate the files together from the command line?