Hash File size exceeding 2GB

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
HemaV
Participant
Posts: 63
Joined: Wed Jan 09, 2008 1:38 am
Location: Bangalore

Hash File size exceeding 2GB

Post by HemaV »

Hi All,
When data is getting copied from table to hashfile its exceeding more than 2GB capacity because of which ds job is failing.
Can you please let me know how to increase 2GB size.

Thanks in Advance,
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

2GB is the limit imposed by 32-bit operating system. If your server is 64 bit, you can convert it to 64 bit hashed file for more space.

Just out of curiosity, can't you restrict number of columns i.e. row length to fit it in 2GB?
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

No need for a 64bit server, 64BIT hashed files are supported on any platform as the limit is the addressing used internal to the hashed file itself. An exact search here for -64BIT will turn up quite a number of conversations on this topic.

Note that your O/S may very well limit files of any kind to 2GB or less, but that really isn't the norm any more.
-craig

"You can never have too many knives" -- Logan Nine Fingers
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

ah, its OS and not server. "and that too isn't norm any more" :oops:
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

No worries, just meant that most operating systems (in my admittedly somwhat limited experience) include 'large file support' out of the box in this day and age of gigabyte flashdrives rather than 1.44MB floppies. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply