merge 4 flat files

sunitha_cts · Post by **sunitha_cts** » Sun Jul 05, 2009 10:44 pm

hi,

u have 4 flat files ,in thes 4 files i have 14 column names same,how could i merge them into single flat file.they are no common values in them.
Thanks
sunitha

vkhandel · Post by **vkhandel** » Sun Jul 05, 2009 11:23 pm

u can merge them using FUNNEL Stage.

ray.wurlod · Post by **ray.wurlod** » Sun Jul 05, 2009 11:52 pm

So can anyone else.

U is the name of one of our posters.

The second person personal pronoun in English is spelled "you", not "u".
Please strive for a professional standard of written English on DSXchange. It assists those whose first language is not English, if they don't have to decode your SMS-style abbreviations.

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Mon Jul 06, 2009 3:15 am

But I can't as I do not have funnel in server jobs

But can do link collector or simple "cat file1 file2...."

Btw, what do you mean by 'merge' ?

nayanpatra · Post by **nayanpatra** » Mon Jul 06, 2009 3:25 am

Funnel stage will solve the problem. If you want sorted output, then you can try with the sort funnel option. Or else sequence funnel option is the best to my opinion as per the performance is concerned.

datskosaraju · Post by **datskosaraju** » Mon Jul 06, 2009 5:44 am

I don't think funnel stage is available in Server edition. As stated by sainath, "Link collector"

chulett · Post by **chulett** » Mon Jul 06, 2009 8:27 am

As noted, there is no Funnel stage in Server jobs. Please pay attention to the job type when posting.

And as normal, Sunitha needs to do a better job of asking questions to get proper answers. What do you mean by "merge" here, especially after making the comment that "they have no common values in them"?

While they may not have common "values" is the metadata the same in all files? If so can you not simply "cat" the four of them together? If not, you need to explain why not.

sunitha_cts · Post by **sunitha_cts** » Mon Jul 06, 2009 10:57 pm

Hi,

moving all the 4 flat files into one flat file,so finally that file is used as input for another job.
i have about 14 columns common in each of the 4 flat files,so i am manually entering the columns and assigning 'null' to the columns not required.
I THINKK THEY IS OTHER OPTION TO DO IN SERVER JOBS.
Thanks
sunitha

ray.wurlod · Post by **ray.wurlod** » Tue Jul 07, 2009 12:08 am

Answer this question. Consider row #1 in each of the four files. Will these result in one row or in four rows in the target file? (We really do need to understand what you mean by "merge".)

DSXchange

merge 4 flat files

merge 4 flat files

Re: merge 4 flat files

Use Funnel Stage

Re: Use Funnel Stage