combinality mode
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 60
- Joined: Sun Nov 21, 2004 2:24 am
combinality mode
What is the functionality of combinality mode in Advance tab of stage? Where it can be useful?
-
- Participant
- Posts: 437
- Joined: Fri Oct 15, 2004 6:13 am
- Location: Pune, India
DS can combine multiple stages as a single process. You can use this mode if you want to decide the combining by your own.
The mode can have values: Auto, Combinable, Don't Combine.
Auto: let the DataStage decide whether to combine the stages
Combinable: Combine the operator with other stage if possible
Don't Combine: do not combine them at all
As multiple stages are running as a single process, sync overhead in stages is also minimized.
The mode can have values: Auto, Combinable, Don't Combine.
Auto: let the DataStage decide whether to combine the stages
Combinable: Combine the operator with other stage if possible
Don't Combine: do not combine them at all
As multiple stages are running as a single process, sync overhead in stages is also minimized.
Regards,
S. Kirtikumar.
S. Kirtikumar.
-
- Participant
- Posts: 47
- Joined: Thu Sep 16, 2004 5:26 am
- Location: India
Hi,
It is in the manuals,but...
combine means try to combine what ever you can to 1 operator.
don't combine means leave all operators seperate as in the job design.
if you read between the lines you see that the later will probably get you better performance.
IHTH,
It is in the manuals,but...
combine means try to combine what ever you can to 1 operator.
don't combine means leave all operators seperate as in the job design.
if you read between the lines you see that the later will probably get you better performance.
IHTH,
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
![Image](http://www.worldcommunitygrid.org/images/logo.gif)
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
![Image](http://www.worldcommunitygrid.org/images/logo.gif)
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
We usually leave it at the default combine mode for faster processing. The only time we change it is when a lookup and a transformer get combined and the reject behaviour becomes different to what we want. You can have a lookup stage with no reject link that sends rows down the transformer reject link before it reaches transformer processing.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
The logic behind not combining operators being faster can be explained via a simple "fill the pool" example.
let us say you want to fill your pool with water.
you have 2 choices:
1. use a single long but narrow hose
2. put many shorter but a lot wider hoses 1 after the other.
suposing you can thruput to maximum any hose caliber, what choice will get your pool filled up faster?
(assuming were not talking 1 pint pools aka bear glases
)
let us say you want to fill your pool with water.
you have 2 choices:
1. use a single long but narrow hose
2. put many shorter but a lot wider hoses 1 after the other.
suposing you can thruput to maximum any hose caliber, what choice will get your pool filled up faster?
(assuming were not talking 1 pint pools aka bear glases
![Wink ;)](./images/smilies/icon_wink.gif)
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
![Image](http://www.worldcommunitygrid.org/images/logo.gif)
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
![Image](http://www.worldcommunitygrid.org/images/logo.gif)