Configuration File

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Bicchu
Participant
Posts: 26
Joined: Sun Oct 03, 2010 10:49 pm
Location: India

Configuration File

Post by Bicchu »

Why in a configuration files nodes are always present in a multiple of two?

Thanks in advance.
Thanks,
Pratik.
jwiles
Premium Member
Premium Member
Posts: 1274
Joined: Sun Nov 14, 2004 8:50 pm
Contact:

Post by jwiles »

Human nature more than any other reason...there is no software or hardware requirement for it.

Regards,
- james wiles


All generalizations are false, including this one - Mark Twain.
Bicchu
Participant
Posts: 26
Joined: Sun Oct 03, 2010 10:49 pm
Location: India

Post by Bicchu »

Is that so? Or there is any logical reason behind this?
Thanks,
Pratik.
jwiles
Premium Member
Premium Member
Posts: 1274
Joined: Sun Nov 14, 2004 8:50 pm
Contact:

Post by jwiles »

Once again, human nature or force of habit. It's quite natural to think in terms of multiples of two: 1, 2, 4, 8 and so on, or in even numbers: 2, 4, 6, 8, etc. Remember, the digital computer world is based on binary logic: powers of two.

Or, from another point of view: When adding nodes to an existing configuration file to increase the parallelism of your job, would you be more likely to a) Double the number of nodes, b) Triple the number of nodes, or c) Add one more node? It's usually much easier for most people to just copy and paste the entire set of nodes (i.e. double the nodes) when editing the config file.

DataStage doesn't care...it will happily (well, as happily as software can) attempt to start your job with however many nodes are defined, whether it be a multiple of two or twenty two, even or odd, or 42, so long as the config file is valid.

Regards,
- james wiles


All generalizations are false, including this one - Mark Twain.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

One thing that gives me the "irrits" is those who suggest running on a single node as the way to "solve" poor partitioning choices.

It's not a solution.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply