I want to know which stage can do this operation faster than the transformer stage:
In my job which gets million of records from the source, i have used a transformer stage which compares the previous record value and current record value and the same consumes more time. inorder to bring down the time it takes, i want to replace the same by another stage, which can perform this opration faster.source data:
col1 col2 col3
10 abc 12345
10 sdf 45689
20 fgr 78965
10 abc 78962
20 fgr 85623
expected output:
col1 col2 col3
10 abc 12345,78962
10 sdf 45689
20 fgr 78965,85623
pls advice me.
Thanks in advance!