Tunables in Administrator

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
arindami
Participant
Posts: 28
Joined: Sat Jan 29, 2005 3:14 pm

Tunables in Administrator

Post by arindami »

Hi

The Hashed file Stage , Read Cache size and Write Cache size from DataStage Administrator.... does it specify the max total size it can cache for all hash files in the project OR is it the value of each individual hash file cache size?

Thanks
avi21st
Charter Member
Charter Member
Posts: 135
Joined: Thu May 26, 2005 10:21 am
Location: USA

Re: Tunables in Administrator

Post by avi21st »

arindami wrote:Hi

The Hashed file Stage , Read Cache size and Write Cache size from DataStage Administrator.... does it specify the max total size it can cache for all hash files in the project OR is it the value of each individual hash file cache size?

Thanks

It specify individual hash file size for Read and Write opertaion. In the Designer it self you can individually tune them.
Avishek Mukherjee
Data Integration Architect
Chicago, IL, USA.
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

The settings are for each Hashed file that will be used in a job.
The default hashed file size is 2GB and the modulo can be increased by the unix admin preferably.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

That answer is not correct.

The Tunables values are the default (not maximum) size to be used for hashed file cache - not hashed files. What you set in the Administrator is the default value; these can be overridden on a per-job basis using the job properties dialog.

The upper limit is theoretically 1000MB, but is constrained by the spin button control to 999MB. Don't go anywhere near these values unless you actually have the (real) memory to support this much demand.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

ray.wurlod wrote:The Tunables values are the default (not maximum) size to be used for hashed file cache - not hashed files. What you set in the Administrator is the default value; these can be overridden on a per-job basis using the job properties dialog.
You're mixing up a couple of different things here. The default Row Buffer size can be set in the Administrator and overriden on a per-job basis. The Hashed File Cache setting are not defaults - those are the values used for the entire project. It would be great if they could be overriden at the job level, but they can't.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

True, too true. Just got out of bed early Saturday morning. You know how it is.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Yes, I do. Be in the same spot not all that many hours from now. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply