Can the size of hashed file cache be controled?

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
olgc
Participant
Posts: 145
Joined: Tue Nov 18, 2003 9:00 am

Can the size of hashed file cache be controled?

Post by olgc »

:?: Hi there,

When a hashed file "pre-load file to memory is Enabled", a warning message as the following is showed. This hashed file is very small (only three rows in it). It doesn't need 128M cache. In another case, the problem is - Unable to allocate memory - means not enough memory for the cache. SO do we have the control of cache size?


Event #:102
Timestamp:31-Mar-2004 1:55:23 PM
Event type:Info
Message:
Ret..S_HashFile.TypeDescIN: Read link private caching enabled, cache size (128MB)[size=18][/size]
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

Why not do it in a routine?
Mamu Kim
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Re: Can the size of hashed file cache be controled?

Post by kcbland »

olgc wrote:When a hashed file "pre-load file to memory is Enabled", a warning message as the following is showed. This hashed file is very small (only three rows in it). It doesn't need 128M cache.
The hash file will use the minimum amount of memory necessary to cache the file. It will not EXCEED this setting. Why you get a YELLOW warning message beats me, but you did post an INFO green message.
olgc wrote: In another case, the problem is - Unable to allocate memory - means not enough memory for the cache. SO do we have the control of cache size?
Only by limiting the data you put into the hash file to be cached. Otherwise, its a maximum cache size.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You have global control over the hashed file cache sizes via the Administrator client's project Tunables tab. The configuration parameter DISKCACHE can also be used.
There is a separate manual on caching hashed files (dsdskche.pdf); reading this should answer all your questions.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

I still say 3 rows then do it in a routine.
Mamu Kim
Post Reply