Stage to map same input column to 2 different output columns

Ezapa · Post by **Ezapa** » Tue Jul 15, 2014 1:13 pm

input stage - Sequential file
output stage - Sequential file

Data flow:
SF-> XXX(stage to be used) -> SF

This flow is used 9 times within the same job

Using which stage do I map a single input column to two different output columns (other than a transformer stage to increase performance),as I have to use this stage 9 times within 1 job.

Example:
input SF has column CUSTID
ouput SF has 2 columns - ID1,ID2

CUSTID from input should be mapped to ID1,ID2.

Thank you

qt_ky · Post by **qt_ky** » Tue Jul 15, 2014 1:28 pm

The Transformer stage can do it. Test it and measure the performance. I think it will perform better than you imagine.

ray.wurlod · Post by **ray.wurlod** » Tue Jul 15, 2014 2:58 pm

The news that the Transformer stage is a performance bottleneck is old news and no longer correct.

That said, you can also use the Column Import stage to effect your requirement.

qt_ky · Post by **qt_ky** » Tue Jul 15, 2014 6:17 pm

I agree. It's sort of become an urban legend.

Ezapa · Post by **Ezapa** » Wed Jul 16, 2014 10:39 am

Thank you all,for the responses.

I have developed 2 jobs, one using the Column inport and the other using the transformer stage.The run time for two of the jobs was almost the same. So I would go with either of the stages.