Parallel transformer versus BASIC Transformer

sumesh.abraham · Post by **sumesh.abraham** » Wed Sep 07, 2011 1:58 pm

I am trying to rewrite a server job to parallel job for performance improvement.
Currently the server job calls 3 server routines. I have 2 options here.

1. Create Parallel routines and call them in the Parallel transformer
2. Use a BASIC transformer and continue to use the
server routines. In this case 1 would need 2 BASIC transformers based on 2 constraints.

Would the usage of BASIC transformer in a parallel job would lower the performance considerably.
I am curious as the original ask is to better the performance of the current job.

ray.wurlod · Post by **ray.wurlod** » Wed Sep 07, 2011 5:42 pm

First off, it is not always the case that parallel is faster than server. For small data volumes a server job can be finished before a parallel job has completed its startup!

Second, whether "usage of BASIC transformer in a parallel job would lower the performance considerably" would depend on a number of factors:
(a) what do you mean by "performance"?
(b) what do you mean by "considerably"?
(c) what is your topology (in particular SMP versus MPP or grid)?

Third, why would you need two BASIC Transformer stages? Why couldn't you use just one?

sumesh.abraham · Post by **sumesh.abraham** » Thu Sep 08, 2011 3:43 pm

Thanks Ray. I don't have a Premium membership currently. I may take it in the future. May I request to please add the missing parts of the reply. Thanks.

ray.wurlod · Post by **ray.wurlod** » Thu Sep 08, 2011 5:08 pm

Premium membership is the means by which DSXchange is kept alive; it is used to pay the hosting and bandwidth costs of the site. I do not propose to undermine that.

Premium membership is not expensive - less than 30c (Rs 11) per day. Don't delay. You have already made 119 posts, so you can't claim there's doubt about the benefit, else you wouldn't have stayed here that long.