How to change server jobs to parallel?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
amitaguptain
Participant
Posts: 12
Joined: Wed Oct 19, 2005 5:29 am

How to change server jobs to parallel?

Post by amitaguptain »

Hi,

In our project we have a requirement where we need to change already exsisting server jobs to parallel.

Can anybody help me tell me the ways of doing that?

Regards,
Amita
amie
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

Why do you need to change existing server jobs to parallel?
Migrating server jobs to parallel may not necessarily improve performance.
Can anybody help me tell me the ways of doing that?
Learn EE.It is different from server edition. You can also enroll in classes conducted by this site the details of which is on the home page.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

"Wetware".

There are no publicly-available conversion utilities. You must apply brain power to the task, and create parallel jobs that replicate the functionality of the server jobs.
Last edited by ray.wurlod on Thu Mar 22, 2007 6:38 am, edited 1 time in total.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Food for thought
- Identify jobs that really require conversion
- Understand whats going on in that server job.
- Translate it into parallel job.

You need in depth understanding of both server and parallel editions for this.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

It's pointless to convert all jobs since many smaller volume jobs will run faster as server jobs. It is dangerous to do a large scale conversion without an expert parallel job developer. IBM offers a conversion service, they have conversion tools in house and a specialised team, they don't advertise this service very well and it wouldn't do 100% of the work, you would still need to test it in house.
The most effective conversion is to start with the jobs that need conversion - any job that is a bottleneck or has extremely high volumes, especially jobs writing to a database. Any job doing a large sort or aggregation could be many times faster as a parallel job. Any job running for a long time on a single thread leaving the server underutilised should be converted to a parallel job or multiple instance server job.
amitaguptain
Participant
Posts: 12
Joined: Wed Oct 19, 2005 5:29 am

Post by amitaguptain »

Thanks a ton!
amie
lstsaur
Participant
Posts: 1139
Joined: Thu Oct 21, 2004 9:59 pm

Post by lstsaur »

Yep, during lunch with IBM's Engineers from Advanced Consulting Group,
I was told that the "conversion service" is available.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Oh, you betcha. As Ray would say, you just need to bring buckets of cash!
-craig

"You can never have too many knives" -- Logan Nine Fingers
ravibabu
Participant
Posts: 39
Joined: Tue Feb 13, 2007 12:18 am
Location: vijayawada

Re: How to change server jobs to parallel?

Post by ravibabu »

amitaguptain wrote:Hi,

In our project we have a requirement where we need to change already exsisting server jobs to parallel.

Can anybody help me tell me the ways of doing that?

Regards,
Amita

Hi,


yes ,i can help you...

This conversion is only help for SMP system not for MPP.

Create the Shared containers and run the jobs in parallel env..

That is one Method..

Any question if your in INDIA call below no; 09999102823..


All the best...
Post Reply