Page 1 of 1

funnel sequential files

Posted: Sun Aug 24, 2008 6:48 pm
by saikiran
I have five seqential files with some common filelds.All the sequential files have different metadata.The objective of my job is to append these seuentilal files one below the other to create a file layout of specific format.
I have to use a funnel stage to combine these seuential files.How can I perform the job with all different sequential file each with different metadata.

Thank you
Sai

Posted: Sun Aug 24, 2008 9:02 pm
by ray.wurlod
Why do you "have to use a Funnel stage" - is this some kind of examination? The Funnel stage requires IDENTICAL metadata on all of its inputs, so you would have to construct these based on your five different sets of metadata. And what fields are required in the output, and from which input file(s) are they sourced? What if the same field exists in two or more if the input files - after all, you've said that there are some "common" fields - which one should be used?

Re: funnel sequential files

Posted: Wed Jun 24, 2009 1:50 am
by changming
saikiran wrote:I have five seqential files with some common filelds.All the sequential files have different metadata.The objective of my job is to append these seuentilal files one below the other to create a file layout of specific format.
I have to use a funnel stage to combine these seuential files.How can I perform the job with all different sequential file each with different metadata.

Thank you
Sai
You can use funnel, but you have to change the meta data to make every incoming records have the name meta.