how to change the read cache memory size for hashfile
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 730
- Joined: Tue Nov 04, 2008 10:14 am
- Location: Bangalore
how to change the read cache memory size for hashfile
the default size is 128 mb, how can i change this setting to a higher value for better performance?
Chances are very, very high that your job's bottleneck is not in reading a hashed file but somewhere else, thus changing buffer and cache sizes, if possible, would not make a difference.
Are you asking about reference reads, or perhaps writes? Also, perhaps you might be looking at public/private link caching - which one might it be?
Are you asking about reference reads, or perhaps writes? Also, perhaps you might be looking at public/private link caching - which one might it be?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Premium Member
- Posts: 730
- Joined: Tue Nov 04, 2008 10:14 am
- Location: Bangalore
There is a whole PDF documenting the differences and link caching functionality, but in most cases it is not necessary to turn on this functionality. Just load your hashed lookup file to memory (just those columns you intend on using) and DataStage will, in almost all cases, do a quick and good job for you.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Premium Member
- Posts: 730
- Joined: Tue Nov 04, 2008 10:14 am
- Location: Bangalore
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: