Join two sequential files in to one file

Hope · Post by **Hope** » Tue May 13, 2008 2:33 pm

I have 2 sequential files each file has 100 records and I am writing it to a sequential file.This file will have 200 records.
Seq file 1 has records Col1 col2 col3 ........col n
10 .... .... ......
10 .... .... ......
10 .... .... ......
10 .... .... ......

Seq file2 has records Col1 col2 col3 ........col n
20 .... .... ......
20 .... .... ......
20 .... .... ......
20 .... .... ......

Now I want the output for Target as Col1 col2 col3 ........col n
10
20
10
20
10

How can I achieve this in PX.

ray.wurlod · Post by **ray.wurlod** » Tue May 13, 2008 4:39 pm

It's not clear from your description. Do you want to select rows alternately from each of the two source files? Are there any other constraints that you haven't included? Are the source files guaranteed to have the same number of rows as the other?

kommven · Post by **kommven** » Tue May 13, 2008 7:39 pm

Be more specific

Hope · Post by **Hope** » Tue May 13, 2008 7:43 pm

Yes I want to select rows alternately from each of the two source files. there are no constraints included and the source files guaranteed to have the same number of rows as the other.The two sources have same number of records.I want to collect one record from each of the file alternately like the Round robin.I know that I can achieve this in server job using the Link collector stage.But not sure how to achieve this in parallel jobs.

Hope · Post by **Hope** » Tue May 13, 2008 7:45 pm

Yes I want to select rows alternately from each of the two source files. there are no constraints included and the source files guaranteed to have the same number of rows as the other.The two sources have same number of records.I want to collect one record from each of the file alternately like the Round robin.I know that I can achieve this in server job using the Link collector stage.But not sure how to achieve this in parallel jobs.

Minhajuddin · Post by **Minhajuddin** » Tue May 13, 2008 8:08 pm

You can use the Funnel stage in Parallel jobs to achieve this.

Hope · Post by **Hope** » Wed May 14, 2008 2:27 am

I did use the funnel stage but I dont get the records in the expected way.I get all 10's together and 20's together.

Minhajuddin · Post by **Minhajuddin** » Wed May 14, 2008 10:19 pm

Try changing the type to Continuous Funnel. This may give you the desired output.

kommven · Post by **kommven** » Thu May 15, 2008 1:15 pm

Hope · Post by **Hope** » Thu May 15, 2008 1:16 pm

That doesn't work too

kumar_s · Post by **kumar_s** » Thu May 15, 2008 3:24 pm

Then why is this thread in Server form?
If you have data in any sorted order, do a sort again based on the same file after funnel.