DSXchange

Hi All,

Plz Clear me some doubt on Hashed file stage.


Can we use hashed file as source and Hashed file as a target?


thanks in advance

Sravan

Hi Sravan,

Yes you can use hash files as a source as well as hash files as a target.

Or did you want to know if you could use them at the same time?

Tim

Thanks tcj,

As well as clear me one more doubt. Is there any limit to use the particular no. of hashed files in the single job.


have a nice time

sravan

There's no theoretical limit.

However, your job might rapidly become unwieldy and difficult to maintain if there are too many stages - irrespective of their type.

What do you consider to be "many"? Why do you think you need that many? Is there a smarter solution?

Sravan,

I don't think there is a set limit to the number of hashed files that you can have in a single job.

The amount of hash files that you can have in your job will be limited by other factors. Such as the amount of RAM on the server. The design of your jobs. (I would be looking at you job design if you had over 10 hash files)

Cheers

Tim

You do not want a single hash file to be both a source and a target because of the way it processes hash files. You can do this in a job but not read transform and write to the same hash file. This is different than write to a hash file and then start reading from it.

Hey want to add up a question along with this topic.
Is there any limit on length of data (or say volume of data ) which can stored in the hash file?
If i want to use a FILE as source and target then wt is better -- to use a seq file or hash file??
If it cannt handle any volume of data then wht is the max? And if go out of the limit wht error it wil give like unable to write to hash file the record ID etc etc.

Upper limits for 64bits is high terabytes. Limit for 32 bit hash file is 2.2 gigabytes. DS only creates 32bit hash files thru the Designer, you have to use command line create statement to get a 64bit file.

kcbland wrote:Upper limits for 64bits is high terabytes. Limit for 32 bit hash file is 2.2 gigabytes. DS only creates 32bit hash files thru the Designer, you have to use command line create statement to get a 64bit file.

Hi Ken,

I had no idea we can do this. I thought because Datastage is a 32 bit environment, the hashed files are always 32bit. Can you let us know more about the command line create statement to get a 64bit file? And the limitations.

Thanks a bunch !

Fire up the Hashed File Calculator on your DataStage CD. It's in the Utilities\Unsupported folder. Play and learn!

ray.wurlod wrote:Fire up the Hashed File Calculator on your DataStage CD. It's in the Utilities\Unsupported folder. Play and learn!

Thanks Ray. I will do that. And may be again get back to you if I have any concern.

I need to ask the client side people for the Datastage CD.