Pre-load file to memory-- HASHFILE STAGE
Moderators: chulett, rschirm, roy
Pre-load file to memory-- HASHFILE STAGE
Hi,
In Hashfile stage it shows preload file to memory- Enabled and disable etc.
Which thing is used to increase the performance in hash file stage?
In Hashfile stage it shows preload file to memory- Enabled and disable etc.
Which thing is used to increase the performance in hash file stage?
-
- Premium Member
- Posts: 273
- Joined: Wed Oct 18, 2006 12:20 pm
- Location: Porto
Re: Pre-load file to memory-- HASHFILE STAGE
"Enable write to cache" , "Preload file to memory" can be configured to enhance the performance of hashed file stageaaha_naga wrote:Which thing is used to increase the performance in hash file stage?
Best would be to go through the Server Job Developer's Guide.
Share to Learn, and Learn to Share.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Premium Member
- Posts: 197
- Joined: Sun Jul 15, 2007 11:45 pm
- Location: Prague
the performance of a Hash "ed" file and not a hash file depends on a few more factors than just this one. the Hash "ed" and not the hash file creates two files with the extension of .data and .overflow which need to be monitored. if the size of the .overflow file is greater than the .data file for a particular Hash "ed" file and not hashfile, you might want to read about modulus etc and set the thier number according to that for the Hash "ed" file and not the hash file your creating.
I hope it helps
I hope it helps
-
- Participant
- Posts: 78
- Joined: Fri Mar 02, 2007 4:54 am
- Location: CHENNAI
-
- Premium Member
- Posts: 273
- Joined: Wed Oct 18, 2006 12:20 pm
- Location: Porto
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The data storage structure is called a hashed file because key values are "hashed" (passed through a hashing algorithm) to determine their physical location.
A hash file is a tool for shaping a block of hash. There is no such thing as a hash file in DataStage.
(There is also a "hash table". This is an IT term and refers to a table with a finite number of rows (or, sometimes, "slots") in memory. These can be used as part of a sorting algorithm or to index data.)
A hash file is a tool for shaping a block of hash. There is no such thing as a hash file in DataStage.
(There is also a "hash table". This is an IT term and refers to a table with a finite number of rows (or, sometimes, "slots") in memory. These can be used as part of a sorting algorithm or to index data.)
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: