Hash Table has grown to ..

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mkkgupta
Premium Member
Premium Member
Posts: 17
Joined: Thu Jan 24, 2008 10:13 pm

Hash Table has grown to ..

Post by mkkgupta »

Hi,

I am pulling data from TD views and it has two joins and two Aggregators.
Data is around 5-10 millon records.
I am getting Hash Table has grown warnings on Aggregator Stage.

How to avoid these warning as I am getting more than 100 warnings.

fyi. I am using a 4x4 node config file.
Regards
Kiran
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Post a sample of the actual unedited errors.
-craig

"You can never have too many knives" -- Logan Nine Fingers
mkkgupta
Premium Member
Premium Member
Posts: 17
Joined: Thu Jan 24, 2008 10:13 pm

Post by mkkgupta »

Hi Craig

Here is the warning message.

"Aggr_Extr2,0: Hash table has grown to 16384 entries. "
Regards
Kiran
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Either demote the warning message to "informational" or suppress the warning altogether; or sort your data and avoid generating the warnings in the first place. I prefer using the latter method, as that is more efficient.
Post Reply