What happens when size increase in a Hash file

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
sunshine
Participant
Posts: 61
Joined: Wed Jan 04, 2006 10:24 am

What happens when size increase in a Hash file

Post by sunshine »

Hi,

What happens to a Hash file,when size is increased?

lets say i am transfering data from database to a Hash file.

I came to know from DSXchange forum that maximum allowable for a Hash file is 2 GB.

Can someone explain in more in detail....


Thanks

sunshine
sunshine
Participant
Posts: 61
Joined: Wed Jan 04, 2006 10:24 am

Re: What happens when size increase in a Hash file

Post by sunshine »

what happens when size of a Hash file increases?
gateleys
Premium Member
Premium Member
Posts: 992
Joined: Mon Aug 08, 2005 5:08 pm
Location: USA

Re: What happens when size increase in a Hash file

Post by gateleys »

Kenneth and Ray have provided their suggestions into this. Follow THIS LINK to a previous post.
sunshine
Participant
Posts: 61
Joined: Wed Jan 04, 2006 10:24 am

what happens when size of a Hash file increases?

Post by sunshine »

what happens when size of a Hash file increases?
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

A recent DSX newsletter contained a white paper on hashed files. Check it out.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Re: what happens when size of a Hash file increases?

Post by ray.wurlod »

sunshine wrote:what happens when size of a Hash file increases?
It gets larger.

If there's free space within its structure that's consumed. After that, it either grows by adding pages (dynamic hashed file) or by extending groups into overflow.

If it's a 32-bit hashed file, the write that tries to take it beyond 2GB will cause internal corruption.

If you've been monitoring its size, and pre-sized it to use 64-bit internal addressing, then the write that tries to take it beyond the largest file the operating system can handle (governed by the O/S itself and your ulimit setting) will cause internal corruption. However, this figure is around 1-19 million TB, so isn't likely to be a problem any time soon.

And, it's "hashed" file, not "hash" file.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply