Hi,
I am getting the following warning in the aggregator stage.
Aggregator_128,1: Hash table has grown to 16384 entries.
I tried searching the forum could not find anything.
Any leads please?
Thanks,
Aggregator_111,1: Hash table has grown to 16384 entries.
Moderators: chulett, rschirm, roy
It is a warning, telling you that the table has become quite large. If you know, understand and expect this you can think about deprecating the warning to an informational one.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 467
- Joined: Tue Mar 20, 2007 6:36 am
- Location: Chennai
- Contact:
An aggregator can do aggregation using two methods:
Hash: This method is best for a small amount of unique "group by" keys (<10000)
Sort: This method would work best for aggregating data which has a large amount of unique "group by" keys. If you use this stage the data has to be sorted and partitioned upon the "group by" keys (If you don't explicitly sort, Datastage puts a tsort operator)
That's the reason you are getting this warning.
Hash: This method is best for a small amount of unique "group by" keys (<10000)
Sort: This method would work best for aggregating data which has a large amount of unique "group by" keys. If you use this stage the data has to be sorted and partitioned upon the "group by" keys (If you don't explicitly sort, Datastage puts a tsort operator)
That's the reason you are getting this warning.
Minhajuddin
<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>