Page 1 of 1

Hash Table has grown to ..

Posted: Wed Oct 21, 2009 9:41 am
by mkkgupta
Hi,

I am pulling data from TD views and it has two joins and two Aggregators.
Data is around 5-10 millon records.
I am getting Hash Table has grown warnings on Aggregator Stage.

How to avoid these warning as I am getting more than 100 warnings.

fyi. I am using a 4x4 node config file.

Posted: Wed Oct 21, 2009 9:56 am
by chulett
Post a sample of the actual unedited errors.

Posted: Wed Oct 21, 2009 11:00 am
by mkkgupta
Hi Craig

Here is the warning message.

"Aggr_Extr2,0: Hash table has grown to 16384 entries. "

Posted: Wed Oct 21, 2009 11:35 am
by ArndW
Either demote the warning message to "informational" or suppress the warning altogether; or sort your data and avoid generating the warnings in the first place. I prefer using the latter method, as that is more efficient.