Search found 2 matches

by Alexander Scherbina
Fri Dec 11, 2009 2:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to improve aggregator performance?
Replies: 5
Views: 3311

ray.wurlod wrote:Welcome aboard. What execution mode are you using for the Aggregator stage? What aggregation mode (sort or hash) are you using? ...
Execution mode is parralel. Aggregation mode is sort.

I forgot to mention that there is no warnings in the job log.
by Alexander Scherbina
Thu Dec 10, 2009 8:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to improve aggregator performance?
Replies: 5
Views: 3311

How to improve aggregator performance?

In my job I have to sum data in 120 columns grouping by 10 other columns. Total number of rows to aggregate is about 5-6 millions. All rows are sorted and partitioned in sort stage before aggregation. But aggregation performance still very low on Aggregator stage - only 2000-3000 rows/sec :( I tried...