DSXchange

Hello, we are wondering if someone could guide us to a stage we can use to bring togther into 1 file, 4 variable files with different meta data for each file. In other words we want to create one big file with records from different files. Some files do have fields that are common with other files. Any help on this would be greatly appreciated. Thanks.

On what basis do you want to "bring them together". Is there some "key" value that you can use to "join" pairs of files, or do you just want all the columns from line 1 in file 1 then all the columns from line 1 in file 2 then all the columns from line 1 in file 3 then all the columns in line 1 in file 4 output on line 1 of the output, then all the columns from line 2 in file 1 then all the columns from line 2 in file 2 then all the columns from line 2 in file 3 then all the columns in line 2 in file 4 output on line 2 of the output, and so on?

Thanks for the response!

We simply need to concatenate variable length files into one big file. The big file will then go through a series of stages. It looks like all the stages require consistent META data for the input and outputs. I'm thinking that we can just run each file through it's own transformer to make the files consistent with each other, then use a funnel to bring them all together. In the end all files need to look the same anyway, so a transformer should work for generating consistency, but it would be a big nice if there was a stage we could use to join?

You could add a record-type tag to each record and then just cat your files together on UNIX..

-BP