Basic Transformer in Parallel Jobs

sk39758 · Post by **sk39758** » Thu Sep 30, 2010 5:29 pm

Hi There,

Just want to know the downside of using basic transformer in parallel jobs.
would it run slow or would it not run in parallel etc?

anbu · Post by **anbu** » Thu Sep 30, 2010 6:39 pm

BASIC transformer can be used in Parallel job. But the job would run slow

sk39758 · Post by **sk39758** » Thu Sep 30, 2010 6:46 pm

anbu wrote:BASIC transformer can be used in Parallel job. But the job would run slow

I know it can be used in parallel jobs.
Could you tell me , why it would run slow?
Is it because it wont run in parallel(on multiple nodes)?

ray.wurlod · Post by **ray.wurlod** » Thu Sep 30, 2010 7:46 pm

It WILL run on multiple nodes. The main reason for its relative slowness is the need to convert to and from the typeless DataStage BASIC environment to the strongly-typed C++ environment of parallel jobs for every row processed.

sk39758 · Post by **sk39758** » Thu Sep 30, 2010 8:25 pm

ray.wurlod wrote:It WILL run on multiple nodes. The main reason for its relative slowness is the need to convert to and from the typeless DataStage BASIC environment to the strongly-typed C++ environment of parallel ...

Thanks Ray....