Using Server routine in Parallel Job
Moderators: chulett, rschirm, roy
Using Server routine in Parallel Job
Hi,
We know that there is a possibility of making use of Server routines in Parallel Jobs. We are planning to write a server routine where we would be reading data in a Hashed File.
If this is possible, then using this server routine, we should be able to read through the data in a Hashed File in a Parallel Job. Please let us know if this is a plausible approach.
Thanks.
We know that there is a possibility of making use of Server routines in Parallel Jobs. We are planning to write a server routine where we would be reading data in a Hashed File.
If this is possible, then using this server routine, we should be able to read through the data in a Hashed File in a Parallel Job. Please let us know if this is a plausible approach.
Thanks.
Re: Using Server routine in Parallel Job
It is possible to call a server routine using a BASIC transformer but it will work only on SMP systems.vnspn wrote:Hi,
We know that there is a possibility of making use of Server routines in Parallel Jobs. We are planning to write a server routine where we would be reading data in a Hashed File.
If this is possible, then using this server routine, we should be able to read through the data in a Hashed File in a Parallel Job. Please let us know if this is a plausible approach.
Thanks.
It took me fifteen years to discover I had no talent for ETL, but I couldn't give it up because by that time I was too famous.
Not a plausible approach. Redesign it so that the contents of a hashed file are now present in a dataset and use a px job to read the dataset. If you could be more clear on what needs to be done, someone here can point you in the right direction.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
1) So, is DataSet the best equivalent of Hashed File in parallel Jobs to do a lookup?
2) Okay, here is the kind of situation that we are into, because of which we were thinking of making use of Hashed Files. We are planning to load a table's data into Hashed File. Then, in another job, call a routine, were we traverse through this Hashed File and do some logic and return the output as the output argument of a routine.
2) Okay, here is the kind of situation that we are into, because of which we were thinking of making use of Hashed Files. We are planning to load a table's data into Hashed File. Then, in another job, call a routine, were we traverse through this Hashed File and do some logic and return the output as the output argument of a routine.
Why we didn't want to have this done in the database level is, we want this logic to be done for each incoming records. So, we didn't want to establish a connection with database for each incoming record.
That was the reason we thought of loading the records into Hashed File once and then making use of the data in the Hashed File as a table.
That was the reason we thought of loading the records into Hashed File once and then making use of the data in the Hashed File as a table.
You dont have to open a connection for each record. A connection remains open and all processing can be done within that one connection. Anywho, I gave you my 2 cents and along with others, provided plausible workarounds. Its your call.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
Just being polite I guess.nick.bond wrote: 2B, I wouldn't even say it's a workaround, it's just using EE as it should be used.
If the OP really feels the dire need to use a hashed file then no problem in using a server job to do it. Its just that, in order to achieve the degree of parallism EE provides, needs to be explicitly incorporated using multiple instances and parallel runs.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
If it's to be a reusable reference table, a Lookup File Set may be preferable to a Data Set, as the index (hash table) on the key gets pre-built when the Lookup File Set is created.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.