Can we Call Server routines in Parallel Extender

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
suri
Participant
Posts: 24
Joined: Tue May 25, 2004 12:17 am
Location: piscataway
Contact:

Can we Call Server routines in Parallel Extender

Post by suri »

Hi All,
Can we call server routines in paralle. I know they use different languages and different compliers. I am wondering is there any way to use server routines in parallel.

Thanks in Advance
Suresh
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

You have several options when moving from a server job to a parallel job:
- use a BASIC Transformer in your parallel job or a server transformer in a parallel shared container. It can call routines but it is a lot slower then most parallel stages.
- move your routine code into a parallel transformer using the derivation fields and stage variables. This is more difficult to maintain and test then routines and not very re-usable but it gives good performance.
- rewrite your basic routines as C++ build ops. This gives good performances and are reusable but requires a knowledge of C programming.
benny.lbs
Participant
Posts: 125
Joined: Wed Feb 23, 2005 3:46 am

Post by benny.lbs »

Suresh,
you can call server routines in PE, however, if you want to run the routines in parallel, you 'd better follow vmcburney 's suggestion.

Vmcburney,
I am interested in the item you have mentioned, say "rewrite your basic routines as C++ build ops".

Can you post some simple sample for our study.

thanks a lot
Benny.lbs
vmcburney wrote:You have several options when moving from a server job to a parallel job:
- use a BASIC Transformer in your parallel job or a server transformer in a parallel shared container. It can call routines but it is a lot slower then most parallel stages.
- move your routine code into a parallel transformer using the derivation fields and stage variables. This is more difficult to maintain and test then routines and not very re-usable but it gives good performance.
- rewrite your basic routines as C++ build ops. This gives good performances and are reusable but requires a knowledge of C programming.
Eric
Participant
Posts: 254
Joined: Mon Sep 29, 2003 4:35 am

Post by Eric »

You could look at the PX Routine Samples on your Install media.
(under the samples directory -> TrxExternalFunctions)
vbeeram
Participant
Posts: 63
Joined: Fri Apr 09, 2004 9:40 pm
Contact:

Post by vbeeram »

You can call as Before/After Sub Routines
Simona
Participant
Posts: 7
Joined: Mon Jan 24, 2005 2:25 pm

Post by Simona »

Can you post some simple C code sample with Makefile using DSAPI in SUNWpro environment, since the PX Routine sample only includes straight C code. Thanks!
Post Reply