hashed file stage
Moderators: chulett, rschirm, roy
hashed file stage
Hi All,
Plz Clear me some doubt on Hashed file stage.
Can we use hashed file as source and Hashed file as a target?
thanks in advance
Sravan
Plz Clear me some doubt on Hashed file stage.
Can we use hashed file as source and Hashed file as a target?
thanks in advance
Sravan
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
There's no theoretical limit.
However, your job might rapidly become unwieldy and difficult to maintain if there are too many stages - irrespective of their type.
What do you consider to be "many"? Why do you think you need that many? Is there a smarter solution?
However, your job might rapidly become unwieldy and difficult to maintain if there are too many stages - irrespective of their type.
What do you consider to be "many"? Why do you think you need that many? Is there a smarter solution?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Sravan,
I don't think there is a set limit to the number of hashed files that you can have in a single job.
The amount of hash files that you can have in your job will be limited by other factors. Such as the amount of RAM on the server. The design of your jobs. (I would be looking at you job design if you had over 10 hash files)
Cheers
Tim
I don't think there is a set limit to the number of hashed files that you can have in a single job.
The amount of hash files that you can have in your job will be limited by other factors. Such as the amount of RAM on the server. The design of your jobs. (I would be looking at you job design if you had over 10 hash files)
Cheers
Tim
-
- Premium Member
- Posts: 503
- Joined: Wed Jun 29, 2005 8:14 am
Hey want to add up a question along with this topic.
Is there any limit on length of data (or say volume of data ) which can stored in the hash file?
If i want to use a FILE as source and target then wt is better -- to use a seq file or hash file??
If it cannt handle any volume of data then wht is the max? And if go out of the limit wht error it wil give like unable to write to hash file the record ID etc etc.
Is there any limit on length of data (or say volume of data ) which can stored in the hash file?
If i want to use a FILE as source and target then wt is better -- to use a seq file or hash file??
If it cannt handle any volume of data then wht is the max? And if go out of the limit wht error it wil give like unable to write to hash file the record ID etc etc.
Upper limits for 64bits is high terabytes. Limit for 32 bit hash file is 2.2 gigabytes. DS only creates 32bit hash files thru the Designer, you have to use command line create statement to get a 64bit file.
Kenneth Bland
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Hi Ken,kcbland wrote:Upper limits for 64bits is high terabytes. Limit for 32 bit hash file is 2.2 gigabytes. DS only creates 32bit hash files thru the Designer, you have to use command line create statement to get a 64bit file.
I had no idea we can do this. I thought because Datastage is a 32 bit environment, the hashed files are always 32bit. Can you let us know more about the command line create statement to get a 64bit file? And the limitations.
Thanks a bunch !
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: