Hash table (hash partition)

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
just4u_sharath
Premium Member
Premium Member
Posts: 236
Joined: Sun Apr 01, 2007 7:41 am
Location: Michigan

Hash table (hash partition)

Post by just4u_sharath »

In the aggregation i have used hash partition. Now my warning is
"Hash table has grown to 32768 entries". This is only a warning. but what should i do now to eliminate these warnings
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Process data containing fewer distinct reference key values would be one way. Use more partitions would help too. Finding a different strategy, such as a sparse lookup or a Join or Merge stage might be another alternative.

As you note, it is only an alert. You could create a message handler to demote its severity from Warning to Informational.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
just4u_sharath
Premium Member
Premium Member
Posts: 236
Joined: Sun Apr 01, 2007 7:41 am
Location: Michigan

Hash table (hash partition)

Post by just4u_sharath »

ray.wurlod wrote:Process data containing fewer distinct reference key values would be one way. Use more partitions would help too. Finding a different strategy, such as a sparse lookup or a Join or Merge stage might be another alternative.

As you note, it is only an alert. You could create a message handler to demote its severity from Warning to Informational.
What is message hnadler and how can i create it
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

In the director job log, right-mouse click on the message you wish to handle and one of the options is, if I recall correctly, "message handler" or something very similar. The documentation also details how to create and use message handlers.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Don't you have manuals or on-line help?
:roll:
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply