Page 1 of 1
Basic Transformer in Parallel Jobs
Posted: Thu Sep 30, 2010 5:29 pm
by sk39758
Hi There,
Just want to know the downside of using basic transformer in parallel jobs.
would it run slow or would it not run in parallel etc?
Posted: Thu Sep 30, 2010 6:39 pm
by anbu
BASIC transformer can be used in Parallel job. But the job would run slow
Posted: Thu Sep 30, 2010 6:46 pm
by sk39758
anbu wrote:BASIC transformer can be used in Parallel job. But the job would run slow
I know it can be used in parallel jobs.
Could you tell me , why it would run slow?
Is it because it wont run in parallel(on multiple nodes)?
Posted: Thu Sep 30, 2010 7:46 pm
by ray.wurlod
It WILL run on multiple nodes. The main reason for its relative slowness is the need to convert to and from the typeless DataStage BASIC environment to the strongly-typed C++ environment of parallel jobs for every row processed.
Posted: Thu Sep 30, 2010 8:25 pm
by sk39758
ray.wurlod wrote:It WILL run on multiple nodes. The main reason for its relative slowness is the need to convert to and from the typeless DataStage BASIC environment to the strongly-typed C++ environment of parallel ...
Thanks Ray....