DS PX - cluster

akrzy · Post by **akrzy** » Mon Nov 28, 2005 9:13 am

Hi,

Does DS have special definition of cluster e.g. N independent computers are connected by installing DS server on each machine and confguring RSH for comunication among the nodes.
Or we should have dedicated OS for cluster?

Anka

vmcburney · Post by **vmcburney** » Tue Nov 29, 2005 10:51 pm

Okay, no replies so I'll take a shot. DataStage has a definition of the cluster within the configuration file of the main server. Some server software needs to be installed on each machine in the cluster but I'm not sure how much. Yes you do need rsh communication between the nodes though I believe you can override this to use ssh instead, I think it's in the install and upgrade guide.

ray.wurlod · Post by **ray.wurlod** » Wed Nov 30, 2005 12:31 am

DS EE is cluster-aware. You do have to have the osh stuff on each machine, but you do not need the complete DataStage server on each machine (contrary to anything a sales person seeking extra commission may claim!).

Player processes on separate machines communicate via TCP sockets, as do section leader processes talking to the conductor process.

track_star · Post by **track_star** » Wed Nov 30, 2005 11:04 am

Look in the Install and Upgrade Guide for copyorchdist if you don't want to install the complete DS package on every node of the cluster. That copies only the binaries and libraries that are required for runtime. You can't create jobs and compile them on the remote nodes, but you will be able to distribute the jobs from your main condictor node across each of the remote nodes. As for rsh vs ssh, you simply modify PXEngine/etc/remsh.example to call whatever path to ssh you have and then save it as remsh (that's also in the Guide).

akrzy · Post by **akrzy** » Thu Dec 01, 2005 8:07 am

Thanks for information