Cluster vs SMP

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Post Reply
blewip
Participant
Posts: 81
Joined: Wed Nov 10, 2004 10:55 am
Location: London

Cluster vs SMP

Post by blewip »

The "Architect" here has decided that we will run a cluster configuration running the engines on 2 x 8 cpu linux boxes.

He seems to think that this will give us high availability.

I was wondering if this this is likely to be more performant than running the engine on a 16 cpu box.

Also which would be cheaper for the license cost, I assume they are the same.

I am guessing GRID would be more.

Any advice, will we get High or Higher Availability with a cluster?
Modern Life is Rubbish - Blur
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

If you have two boxes you can have true high availability, in either active-active or active-passive configuration. Read all about this in the Planning, Installation and Configuration Guide. However, that would give you high availability of an eight core configuration.

Active-active is the highest cost. Active-passive is cheaper. Single 16 core might be about the same as active-passive or slightly cheaper, depending upon the processor type (research processor value units (PVUs), IBM's basis for licensing charges).

Grid configuration ought not to make any difference to your licence cost for the same maximum number of processors, again depending upon how you decide to configure (e.g. number of head nodes vs number of compute nodes).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

I believe that "active-active" is what the doc refers to as "fully clustered." You license according to what is active.
Choose a job you love, and you will never have to work a day in your life. - Confucius
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Not really. Both active-active and active-passive refer to how failover is managed.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
blewip
Participant
Posts: 81
Joined: Wed Nov 10, 2004 10:55 am
Location: London

Post by blewip »

Thanks for the replies. Just to clarify:

With Grid the workload is shared over the available machines. If one goes down the work continues on the available machines.
This has a cost though.

With two boxes, there is the performance option, or the HA option.

HA: Run on one box and the other box is standby if it goes down.

Performance: The job runs on nodes on both machines. There is no HA, although the boxes could be re-configured to run on one machine.

Is this the case?

Regards
Modern Life is Rubbish - Blur
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

The license costs and performance depends on which tier or tiers you are talking about, and what type of HA you might configure (lower cost active-passive vs. an alternative). There are so many topology and HA variations to choose from. One HA consideration is automatic vs. manual failover and whether or not you're willing to wait 10-15 minutes for the failover to take place (HA with a 15 minute failover vs. 24x7 HA). It may help to clarify which tiers will land where or if you're only talking about the engine tier.
Choose a job you love, and you will never have to work a day in your life. - Confucius
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Check out this IBM Redbook and share it with your architect. :)

IBM InfoSphere Information Server Deployment Architectures
Choose a job you love, and you will never have to work a day in your life. - Confucius
blewip
Participant
Posts: 81
Joined: Wed Nov 10, 2004 10:55 am
Location: London

Post by blewip »

Hi Eric

Thanks for that, we are talking about just the engine tier.

From what I can work out, an MPP Topology setup allows all the engine to be used at once.
But if one goes down it says "A failure of single server will have a corresponding fractional impact on the total server resources that are available."

This sounds better than the Active Passive Cluster (and the Active - Active Cluster?). It appears only one engine is used at once and it says "In the event of a hardware failure of the active server, the HA software unmounts the external storage from the previously active server, and mounts it on the passive server".

However I guess with the MPP you are paying license for all engine servers, where as with Active Passive you are only paying for one.
Modern Life is Rubbish - Blur
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

blewip wrote:But if one goes down it says "A failure of single server will have a corresponding fractional impact on the total server resources that are available."
In an active-active cluster, or MPP, or grid setup, you do have to license the max that is active. In your scenario, if one engine system goes down then the fraction is 50%. If you switched things up a bit and and 8 x 2 cpu boxes, then if one goes down, you're in better shape.

The active-passive cluster would cost less and give you some HA assurance, with 8 cores max active at once.

One thing you have to watch out for these days is that servers have so many layers of virtualization that it can get more confusing. For instance, if you allocated 2 x 8 cpu servers or 8 x 2 cpu servers, etc., you would not want to find out after a physical failure that all such LPARs were running on the same physical unit.
Choose a job you love, and you will never have to work a day in your life. - Confucius
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

qt_ky wrote:you would not want to find out after a physical failure that all such LPARs were running on the same physical unit.
That never happens. :wink:

We recently found out that our wonderful hardware partner has almost all of our virtual servers - dev, test *and* production - on a single physical server. :shock:
-craig

"You can never have too many knives" -- Logan Nine Fingers
blewip
Participant
Posts: 81
Joined: Wed Nov 10, 2004 10:55 am
Location: London

Post by blewip »

I can imagine.

Everyone really hopes you are right!
Modern Life is Rubbish - Blur
Post Reply