how can i improve performance in Aggregator

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
chanthou_2000
Participant
Posts: 11
Joined: Mon Jun 16, 2003 2:21 am

how can i improve performance in Aggregator

Post by chanthou_2000 »

hello,

i'm looking for some ways to improve performance of Aggregator Stage.
But i didn't find any options to say to DS that my source is already sorted (i use an order by sql clause) like in DS 5.0 Server where there was such options (i used to use it !)

Thank you

Chanthou
thebird
Participant
Posts: 254
Joined: Thu Jan 06, 2005 12:11 am
Location: India
Contact:

Post by thebird »

Chanthou,

There is an option in the sort stage- sort mode, where you can sprecify : "Don't Sort (Previously Sorted)".

Hopefully this will take care of your issue.

Regards,
The Bird.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The options for specifying sorted input are in the Columns grid in server job Aggregator stages.

In parallel stages, sorting of input is managed as a property of the input link; I don't have access to PX at the moment to give you specifics, but it's certainly possible.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
s1kaasam
Participant
Posts: 17
Joined: Wed Feb 02, 2005 5:11 pm
Location: virginia

Post by s1kaasam »

In the aggregator stage there is in the option section wherein you could select the method to be sort instead of hash.

Now before you run into this aggregator use a sort stage and sort it on the the grouping keys of the aggregator.

The partitioning into the sort stage hash it on the grouping keys and into the aggregator keep it auto.

try this and I am sure you would have better performance gain.

Any questions let me know.
shravan
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Is it really must to do a sort using a sort stage before an aggregator everytime, bcoz when i tried with an un presorted data it worked same.
In the other case, why cant we maintain the partition as "Same" in Aggregator followed by sort stage.
Post Reply