Aggregator_111,1: Hash table has grown to 16384 entries.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
rager
Participant
Posts: 27
Joined: Tue Jul 17, 2007 11:23 pm
Location: UK

Aggregator_111,1: Hash table has grown to 16384 entries.

Post by rager »

Hi,
I am getting the following warning in the aggregator stage.

Aggregator_128,1: Hash table has grown to 16384 entries.


I tried searching the forum could not find anything.

Any leads please?

Thanks,
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

It is a warning, telling you that the table has become quite large. If you know, understand and expect this you can think about deprecating the warning to an informational one.
Minhajuddin
Participant
Posts: 467
Joined: Tue Mar 20, 2007 6:36 am
Location: Chennai
Contact:

Post by Minhajuddin »

An aggregator can do aggregation using two methods:
Hash: This method is best for a small amount of unique "group by" keys (<10000)
Sort: This method would work best for aggregating data which has a large amount of unique "group by" keys. If you use this stage the data has to be sorted and partitioned upon the "group by" keys (If you don't explicitly sort, Datastage puts a tsort operator)

That's the reason you are getting this warning.
Minhajuddin

<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
Post Reply