hashed file through parallel jobs

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
tostay2003
Participant
Posts: 97
Joined: Tue Feb 21, 2006 6:45 am

hashed file through parallel jobs

Post by tostay2003 »

Hi,

I know that we can't use hashed file through parallel jobs, but can we use UV database to access via parallel job (which contacts datasets etc).

Thanks
OddJob
Participant
Posts: 163
Joined: Tue Feb 28, 2006 5:00 am
Location: Sheffield, UK

Post by OddJob »

When you create a Parallel job check to se if you have a Universe database control.

I tried this and didn't see one, and there don't appear to be any ODBC drivers either.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

If you have UniVerse installed then you can access UniVerse hashed files from DataStage PX through ODBC. The DataStage engine doesn't have this functionality enabled, but I suspect that UniVerse can still access DataStage hashed files.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

ArndW wrote:I suspect that UniVerse can still access DataStage hashed files.
Only if there are no I-types and no indexes involved. Otherwise the magic numbers do not match and access is impossible.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The biggest issue is that the UniVerse database is not distributed, therefore can not be accessed from any processing node that is not also the conductor node.

If you restrict the stage to execute only on the machine where UniVerse is installed, then there are several ways that you could access hashed files, including through a command line interface (External... stage) or your own routine that uses the InterCall or ICI API.

I suspect you could even use an ODBC Enterprise stage connecting to the localuv data source.

But why do you want to use hashed files in a parallel job anyway?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply