Stage which does this logic

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vij
Participant
Posts: 131
Joined: Fri Nov 17, 2006 12:43 am

Stage which does this logic

Post by vij »

Hi all,

I want to know which stage can do this operation faster than the transformer stage:
source data:
col1 col2 col3
10 abc 12345
10 sdf 45689
20 fgr 78965
10 abc 78962
20 fgr 85623

expected output:
col1 col2 col3
10 abc 12345,78962
10 sdf 45689
20 fgr 78965,85623
In my job which gets million of records from the source, i have used a transformer stage which compares the previous record value and current record value and the same consumes more time. inorder to bring down the time it takes, i want to replace the same by another stage, which can perform this opration faster.

pls advice me.

Thanks in advance!
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The operation is called a vertical pivot. You can perform it faster with a Build stage.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
vij
Participant
Posts: 131
Joined: Fri Nov 17, 2006 12:43 am

Post by vij »

thanks but I donot find the build stage even when customizing the palette.can you please tell me where can I find it?
mansoor_nb
Participant
Posts: 48
Joined: Wed Jun 01, 2005 7:10 am

Post by mansoor_nb »

Build Stage is an Custom defined stage and also you can use Combined Record Stage for this.The incoming data should be presorted for this.
Post Reply