Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.
Moderators: chulett , rschirm , roy
vishu19aug
Participant
Posts: 39 Joined: Mon Feb 13, 2012 1:30 pm
Post
by vishu19aug » Mon Jun 25, 2012 1:02 pm
Hi,
I need to do the following Oracle functionality in Datastage -
sum(case when field1 = 'X' then 1 else 0) countx,
sum(case when field1 = 'Y' then 1 else 0) county
Is it possible to do this in aggregator stage or i need to put this logic in transformer stage before the aggregator.
Thanks,
Vishal
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Mon Jun 25, 2012 1:05 pm
Transformer before then sum in the Aggregator.
-craig
"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607 Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Post
by ray.wurlod » Mon Jun 25, 2012 5:05 pm
Or do the summing in the Transformer itself.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
zulfi123786
Premium Member
Posts: 730 Joined: Tue Nov 04, 2008 10:14 am
Location: Bangalore
Post
by zulfi123786 » Tue Jun 26, 2012 1:24 am
ray.wurlod wrote: Or do the summing in the Transformer itself.
summations in transformer Vs summations in aggregator
Could you please highlight the performance trade off amongst the two choices ?
- Zulfi
ray.wurlod
Participant
Posts: 54607 Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Post
by ray.wurlod » Tue Jun 26, 2012 4:11 am
No idea. Define what you understand by "performance" in an ETL context.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
zulfi123786
Premium Member
Posts: 730 Joined: Tue Nov 04, 2008 10:14 am
Location: Bangalore
Post
by zulfi123786 » Tue Jun 26, 2012 7:12 am
Performance - Faster computation with least resources consumed :D
- Zulfi
ray.wurlod
Participant
Posts: 54607 Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Post
by ray.wurlod » Tue Jun 26, 2012 5:05 pm
In that case, try both while monitoring or gathering performance statistics.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.