Problem while Looking up in Distributed Hashed File

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
Gokul
Participant
Posts: 74
Joined: Wed Feb 23, 2005 10:58 pm
Location: Mumbai

Problem while Looking up in Distributed Hashed File

Post by Gokul »

Hi All,

I have created a Distributed Hashed Files EMPLOYEESALL with part files as
EmployeesATOL ,EmployeesMTOV and EmployeesWTOZ.

Data is loaded in the hashed file EMPLOYEESALL. But when i use hashed file EMPLOYEESALL as a lookup with Pre-Load file to memory enabled or Enabled,Lock for Updates ,it gave me error

DataStage Job 46 Phantom 2356
Program "DSD.UVOpen": Line 572, Exception raised in GCI subroutine:
Access violation.
Attempting to Cleanup after ABORT raised in stage LookupMulitpartHash..Hashed_File_2
DataStage Phantom Aborting with @ABORT.CODE = 3

When i set the Pre-Load file to memory to disabled or Disabled,Lock for Updates, the lookup works fine.

Why does the Distributed file behave like this.
If the distributed hashed files work this way, then will it not slow down the process as we are not able to pre-load the hashed file during lookup.

Thanks,
Gokul
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Gokul,
this is a bug that should be reported to your support provider. Most likely the solution is going to be that this functionality is going to be explicitly disallowed, since it will be a lot of work to duplicate the distributed memory mechanism in a memory file. I would not hold my breath waiting for a solution to this.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I don't believe this is a bug but rather a known limitation of distributed hashed files. You cannot cache them - individual parts, yes - but the whole, no. Should be documented somewhere...
-craig

"You can never have too many knives" -- Logan Nine Fingers
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Craig - I did a quickie search to see if I could find it documented but couldn't find a limitation anywhere. But after this is submitted I'm sure it will show up in the future documentation.
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

64BIT and distributed files have never been cache supported, AFAIK.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Distributed hashed files have never been cache supported (definitely) and never will be.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply