Page 1 of 1

Best way to start developing using parallel jobs

Posted: Mon Mar 26, 2007 10:13 am
by Mike3000
I have a good experience of doing development using Server jobs, but
now client wants to use DS Parallel Jobs.

Could you tell me please what is the best approach to make a smooth
transition to the DS Parallel Edition from DS Server Edition? and in
your opinion how difficult/time consuming is it?

Posted: Mon Mar 26, 2007 10:27 am
by DSguru2B
Welcome Aboard :)
My advice, go for Server To Parallel transition classes. Ray's class is going on in Dallas as we speak.

Posted: Mon Mar 26, 2007 11:05 am
by ravibabu
Hi



Please try to avoid Xrm and if is there any datatype modification and datatye conversion use the MODIFY stage.


and soon many.....

Posted: Mon Mar 26, 2007 11:10 am
by karthegx
ya that's correct use as many diffferent stages avilable in parallel jobs ,reduce most of the xrm stages . and use Remove Duplicates stage for removing duplicates if u have any.........

Posted: Mon Mar 26, 2007 11:13 am
by DSguru2B
No need to avoid the transformer stage as its performance has been greatly increased in 7.x versions. No doubt, modify stage still leads the two, but transformer is faster than filter stage and a few other stages. IBM released this information sometime back.

Posted: Mon Mar 26, 2007 11:22 am
by ravibabu
Yes ,You may worng sir...Bcz Xrm is generate the c++ code and this stage consumed the large memory compary to other stages.
Other stages generate the hash file entrys.That is the resone to avoid the Xrm stage. Xrm stage want so many section leaders and players.
But other stages not like that.....if i am worng correct me...

Posted: Mon Mar 26, 2007 11:51 am
by Mike3000
Thank you Guys for your answers.

So, i still can use the old functionality and as i go ,
i can gradually add a new functionality of Parallel jobs.

Could you suggest any books about Parallel Jobs or may be a
good link? It would be greatly appreciated.

Posted: Mon Mar 26, 2007 11:59 am
by DSguru2B
True. But my comment was w.r.t performance.
Memory demands follow simple economics. Demand and supply. I have never had memory leaks with a transformer stage. I have had memory violations while using custom px routine but that was my own faulty memory management in the C code. Other than that, the transformer jobs run like a breeze.

Posted: Mon Mar 26, 2007 12:13 pm
by ravibabu
Thanks for you reply.


Any one please send the best online guide for PX and Server.

That could be helpful to all.

Posted: Mon Mar 26, 2007 5:29 pm
by ray.wurlod
There are no online guides. Only the manuals that come with the product.

Posted: Wed Jul 04, 2007 2:29 am
by ag_ram
DSguru2B wrote:No need to avoid the transformer stage as its performance has been greatly increased in 7.x versions. No doubt, modify stage still leads the two, but transformer is faster than filter stage and a few other stages. IBM released this information sometime back.
Hi DSGuru

Can you share the link where IBM document is available that speaks about comparison of Filter and Transformer (transformer is faster than filter stage and a few other stages. IBM released this information sometime back)
I tried to search IBM and Ascential Developer Net (IBM Forum) , i did not manage to get the same.

Posted: Wed Jul 04, 2007 1:01 pm
by ray.wurlod
The information that IBM released "some time back" was for version 7.0 and earlier and has been overtaken by events. Now they're advising (in their training classes) that Transformer should be perferred to Filter, on the grounds that it's compiled and Filter is "interpreted". I believe the justification is spurious, because the filter operator is an instance of an object for which the class is written in C++, so there ought to be little to choose between them. But I have no benchmarks to support that belief.