what is the meaning of allow multiple instances?

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
mallikharjuna
Participant
Posts: 81
Joined: Thu Nov 30, 2006 7:46 am
Location: india

what is the meaning of allow multiple instances?

Post by mallikharjuna »

what is the meaning of allw multiple instances in server jobs?
MALLI
trobinson
Participant
Posts: 208
Joined: Thu Apr 11, 2002 6:02 am
Location: Saint Louis
Contact:

Post by trobinson »

When this checkbox is checked and the job compiled, one can run more than one copy of the job at a time. It means exactly what is says. Multiple instances (copies) of a DataStage job can be run simultaneously. The Engine can do this by appending an invocation id to each running instance.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

You will have single job with single executable, but you can instantiate different instance of same job using different Invocation Id passed during run time. Its basically to reuse same set of code multiple times for several input.
Pls go through the given document, or search the forum to get full details about it.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

ps. The 'Help' for this concept is in the online help accessable from the Director.
-craig

"You can never have too many knives" -- Logan Nine Fingers
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Its synonymous to multiple threads. Using Multiple Instance Jobs, one can incorporate massive parallism in a server job. Huge performance gains can be noticed for high volumes of data.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

Just to be clear, a thread is not the same as a job instance. Multi-threaded and multi-processing are two different things.

Multi-threaded is like juggling: there's multiple balls in the air, but one person is managing catching and throwing.

Multi-processing is liike making clones of a one-ball juggler, there's N jugglers each with one ball throwing and catching to him/herself. Partitioned parallelism is the heart of this concept.

Multi-instancing synonymous to multi-processing. You achieve even greater heights of processing throughput with multi-threaded multi-processing.

Multi-processing gives you more results sooner because it's usually more scalable. Imagine deriving a row of data, where all columns are simultaneously derived. Each column is derived in an independent thread and brought together by the thread manager. This multi-threaded handling is probably much more expensive than simply top-down deriving the set of columns. However, processing multiple rows simultaneously would yield much greater results. If you're row-order processing restricted, you would partition wisely but then use multi-processing on each partitioned set. Even with inter-processing, row buffering, or independent stages (operators) with FIFO buffering still follow multi-processing framework.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

I stand corrected. Your right, mult-threading is processed by a single control where as multiple instance is synonymous to making clones. Great example Ken.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

There's a lot less that can go wrong juggling one ball compared to juggling many! Robustness stems from an approach that uses multi-processing rather than multi-threading.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply