Page 1 of 1

Stage to map same input column to 2 different output columns

Posted: Tue Jul 15, 2014 1:13 pm
by Ezapa
input stage - Sequential file
output stage - Sequential file

Data flow:
SF-> XXX(stage to be used) -> SF

This flow is used 9 times within the same job

Using which stage do I map a single input column to two different output columns (other than a transformer stage to increase performance),as I have to use this stage 9 times within 1 job.

Example:
input SF has column CUSTID
ouput SF has 2 columns - ID1,ID2

CUSTID from input should be mapped to ID1,ID2.

Thank you

Posted: Tue Jul 15, 2014 1:28 pm
by qt_ky
The Transformer stage can do it. Test it and measure the performance. I think it will perform better than you imagine.

Posted: Tue Jul 15, 2014 2:58 pm
by ray.wurlod
The news that the Transformer stage is a performance bottleneck is old news and no longer correct.

That said, you can also use the Column Import stage to effect your requirement.

Posted: Tue Jul 15, 2014 6:17 pm
by qt_ky
I agree. It's sort of become an urban legend.

Posted: Wed Jul 16, 2014 10:39 am
by Ezapa
Thank you all,for the responses.

I have developed 2 jobs, one using the Column inport and the other using the transformer stage.The run time for two of the jobs was almost the same. So I would go with either of the stages.