Search found 21 matches

by jmessiha
Tue Feb 22, 2005 11:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: What do I need to now about sharing hash files between jobs?
Replies: 10
Views: 3327

Where do you go to enable these different types of caching? Have your DS guy reread the section on System Caching. Guidelines for Choosing a Type of Caching Use the following as a guideline as you select the type of caching to use: To Use Share between reference and output files in a single data str...
by jmessiha
Sun Dec 19, 2004 10:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hashed File in a Server Shared Container for read access PX
Replies: 10
Views: 3388

T42 wrote:Land it to a sequential file in server. In PX, pull it and use a regular lookup stage.
Won't that result in the same or poorer performance than the hashed file in a server container?
by jmessiha
Thu Dec 16, 2004 1:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hashed File in a Server Shared Container for read access PX
Replies: 10
Views: 3388

I was thinking that because the parallel partitions were only reading the hashed file, it wouldn't be a problem (as opposed to writing to it). Are you sure that it will bottle-neck there? If so, what recommendations for alternative solutions might you have?
by jmessiha
Wed Dec 15, 2004 11:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hashed File in a Server Shared Container for read access PX
Replies: 10
Views: 3388

Are you saying that each individual partition in the parallel stream will have to wait its turn to read the hashed file? They cannot read the same file at the same time?
by jmessiha
Wed Dec 15, 2004 9:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hashed File in a Server Shared Container for read access PX
Replies: 10
Views: 3388

So you're saying that there will be no bottle-neck while performing a parallel lookup on a hashed file inside of a shared server container?
by jmessiha
Wed Dec 15, 2004 12:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hashed File in a Server Shared Container for read access PX
Replies: 10
Views: 3388

Hashed File in a Server Shared Container for read access PX

I created a hashed file in a server job that I want to be able to lookup against from within a parallel job after it is created, so I put the hashed file into a server shared container and then put the server shared container into my parallel job and it seems like it will work. So far so good. My qu...