Page 1 of 1

Basic Transformer in Parallel Jobs

Posted: Thu Sep 30, 2010 5:29 pm
by sk39758
Hi There,

Just want to know the downside of using basic transformer in parallel jobs.
would it run slow or would it not run in parallel etc?

Posted: Thu Sep 30, 2010 6:39 pm
by anbu
BASIC transformer can be used in Parallel job. But the job would run slow

Posted: Thu Sep 30, 2010 6:46 pm
by sk39758
anbu wrote:BASIC transformer can be used in Parallel job. But the job would run slow
I know it can be used in parallel jobs.
Could you tell me , why it would run slow?
Is it because it wont run in parallel(on multiple nodes)?

Posted: Thu Sep 30, 2010 7:46 pm
by ray.wurlod
It WILL run on multiple nodes. The main reason for its relative slowness is the need to convert to and from the typeless DataStage BASIC environment to the strongly-typed C++ environment of parallel jobs for every row processed.

Posted: Thu Sep 30, 2010 8:25 pm
by sk39758
ray.wurlod wrote:It WILL run on multiple nodes. The main reason for its relative slowness is the need to convert to and from the typeless DataStage BASIC environment to the strongly-typed C++ environment of parallel ...
Thanks Ray....