Migrating hash file

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
dr.murthy
Participant
Posts: 224
Joined: Sun Dec 07, 2008 8:47 am
Location: delhi

Migrating hash file

Post by dr.murthy »

Hi,
In my project some of the jobs we are going to migrate server edition to px,we have an issue with hash file while migrationg we are aditinally building a one serverjob and one parallel job new , which loads hash file data into seq file then seq file into dataset.

is there any other way to implement this changes to get hash file data on parallel console.
D.N .MURTHY
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

No. The Hashed File stage is only available in server jobs or server shared containers. You *can* use server shared containers in parallel jobs under specific conditions, which are detailed in Chapter 2 of the Parallel Job Developer's Guide.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
PhilHibbs
Premium Member
Premium Member
Posts: 1044
Joined: Wed Sep 29, 2004 3:30 am
Location: Nottingham, UK
Contact:

Post by PhilHibbs »

Is there a Parallel Job stage that gives equivalent functionality to the Hashed File? Lookup File Set doesn't work because writing to it clears down existing content (unless I'm missing something)

Thinking a little further - I'm half-expecting the answer to be "no", given the parallel and partitioned nature of the task. Maybe I can manage by re-creating the LFS with the additional content at the end of each run.

*Update*: Hm. Fly in the ointment - can't stream out from a Lookup File Set in order to create a new set with the additional rows. Any suggestions, other than also creating a regular File Set at the same time as the lookup File Set?
Phil Hibbs | Capgemini
Technical Consultant
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Hashed files can be accessed as ODBC sources - performance is going to be quite a bit slower than accessing them in server jobs.
Post Reply