link collector

[kollurianu]

Hi all,

Can i use Link collector alone to to combine the two files (concatenate)

or should link collector and link partitioner go together.

Thank you all,

[kcbland]

Just the collector. If all you're trying to do is concatenate exact metadata matching files, just use a Unix cat statement. That's really fast and easy. Using a link collector requires both input links have the exact same metadata, so after your sequential stages you'll want a transformer to adjust the metadata accordingly.

You'll probably need to consider an extra column to identify where the row originated, file 1 or file 2.

[kollurianu]

Yes all the input links have the same metadata , so in that case can i use

link collector to combine the outputs .

Thank you,
Purna.

[kumar_j]

there is no rule that u should use the link collector with link partition stage
if u jave 2 input seq stage u can use link collector stage to club but the meta data should be the same for both the input files

[ray.wurlod]

If the inputs are Sequential Files with identical metadata you don't need DataStage at all; you can simply use cat to append the contents of the second to the first. If you then need to work on the composite result, use a Sequential File stage to process the result - maybe use a cat command in a filter.

[kollurianu]

Thank you Ray , i was thinking like that too,

can i just give cat and file names f1 and f2 in the filter box of target sequential stage.

Thank you all.