Input to Merge Stage

sbass1 · Post by **sbass1** » Tue Mar 17, 2009 12:34 am

If I have a job that does:

Seq_1 --> xfm --> Seq_1_New

Seq_2 --> xfm --> Seq_2_New

and I then want to merge Seq_1_New and Seq_2_New, how do I ensure that the Merge stage waits until the files are written?

I tried a "naked" merge stage with no input streams, but it was executing synchronously, i.e. at the same time the output files were being created.

I tried linking the merge stage with IPC, etc, but since it accepts no input I couldn't link it to any preceding stage.

ray.wurlod · Post by **ray.wurlod** » Tue Mar 17, 2009 3:12 am

Use two jobs?

sbass1 · Post by **sbass1** » Tue Mar 17, 2009 4:56 am

Yep, that would be a crude workaround.

Is that a tacit admission that the server merge stage is poorly designed?

ray.wurlod · Post by **ray.wurlod** » Tue Mar 17, 2009 3:23 pm

"Poor" is a value judgment. The Merge stage has to read two files; it does not have input links.