Page 1 of 1

Stage which does this logic

Posted: Wed Jan 17, 2007 12:55 am
by vij
Hi all,

I want to know which stage can do this operation faster than the transformer stage:
source data:
col1 col2 col3
10 abc 12345
10 sdf 45689
20 fgr 78965
10 abc 78962
20 fgr 85623

expected output:
col1 col2 col3
10 abc 12345,78962
10 sdf 45689
20 fgr 78965,85623
In my job which gets million of records from the source, i have used a transformer stage which compares the previous record value and current record value and the same consumes more time. inorder to bring down the time it takes, i want to replace the same by another stage, which can perform this opration faster.

pls advice me.

Thanks in advance!

Posted: Wed Jan 17, 2007 3:11 am
by ray.wurlod
The operation is called a vertical pivot. You can perform it faster with a Build stage.

Posted: Wed Jan 17, 2007 6:37 am
by vij
thanks but I donot find the build stage even when customizing the palette.can you please tell me where can I find it?

Posted: Wed Jan 17, 2007 10:23 am
by mansoor_nb
Build Stage is an Custom defined stage and also you can use Combined Record Stage for this.The incoming data should be presorted for this.