Group Determination

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vinodn
Charter Member
Charter Member
Posts: 93
Joined: Tue Dec 13, 2005 11:00 am

Group Determination

Post by vinodn »

I need help regarding group ditermination.

My input looks like this. the first 3 columns are my key.

10,20,30,A
10,20,30,X
10,20,40,B
10,20,50,Y
10,20,50,Z
10,20,60,D

My output need to be

1st o/p :

10,20,30,A
10,20,30,X
10,20,50,Y
10,20,50,Z

2nd o/p
10,20,40,B
10,20,60,D

I can do this by using the count function in the aggregator and where count >1 (by grouping on the 1st 3 columns) can be routed to 1st output and count =1 to the 2nd output, I want to know if this can be done in the transformer(like the dedup logic).

Thanks for your help.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

If you're in a version of DataStage that supports looping in the Transformer stage then yes. Otherwise probably not.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

I would think you can by using the Sort stage key change column plus Transformer stage.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply