What ports does DataStage really use?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

What ports does DataStage really use?

Post by vmcburney »

I am having a problem identifying the range of ports that Information Server 8.1 and DataStage use for TC/PIP between the server and the client. The documentation lists a certain set of ports such as 9080 and 31531. However, after getting a connection request the Linux operating system appears to open a random free port between the server and the client just for that session to run in duplex mode. So regardless of how DataStage is installed and configured there does not seem to be much control over what ports are used from the direction of the server back to the client.

Does anyone know how TC/PIP uses ports? Is it supposed to open up a random port between the server and the client? Has anyone configured an Information Server environment to only run through a defined set of open ports?
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Here with 8.0.1 and AIX the list is:

2809, 9043, 9080, 9100, 9403, 13400, 13401,31531, 31533, 31538
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Unless you change it, 31538 is the port number on which dsrpcd listens and therefore the port number used for all clients to communicate with their agent process (dscs or dsapi_server) on the server, since the latter are child processes of dsrpcd. It's not random.

The other port numbers are used for different things, for example port number 9080 is used by IBM Information Server and port number 9060 is used by the WebSphere Application Server.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
crouse
Charter Member
Charter Member
Posts: 204
Joined: Sun Oct 05, 2003 12:59 pm
Contact:

Post by crouse »

ArndW wrote:Here with 8.0.1 and AIX the list is:

2809, 9043, 9080, 9100, 9403, 13400, 13401,31531, 31533, 31538
Arnd,

What did you do to get this port list?

Struggling here the same as Vincent.

-Craig
Craig Rouse
Griffin Resouces, Inc
www.griffinresources.com
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

This is a trial-and-error list. The site put in a firewall which blocked each and every port in the system unless explicitly enabled. These were the ones that I had to open for DataStage at V8.0.1. I don't have the list of exactly which portions use which ports, but I will see if I can find that as well.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Parallel jobs will also use port number 10000 and port numbers rising from 11000.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Ray, this is a PX installation and those ports are closed between client and server. Or do you mean runtime port usage on a single machine?
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

ArndW wrote:Here with 8.0.1 and AIX the list is:

2809, 9043, 9080, 9100, 9403, 13400, 13401,31531, 31533, 31538 ...
In our project , we are using 31542 port .
Nag
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Nagarjuna - what are you using that port for?
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

31538 is the default port number on which dsrpcd listens and In our project its configured to 31542 .
Nag
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

ArndW wrote:Ray, this is a PX installation and those ports are closed between client and server. Or do you mean runtime port usage on a single machine?
These ports are not used between client and server. Port #10000 is used between conductor and section leader processes on processing nodes, ports #11000 and up are used by player processes (mainly when re-partitioning).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

I agree, the port range of 10000 and 11000 and above is for the DataStage parallel server back to the conductor and should not be needed on the client.

What I am finding is a "Connection timed out" error for client tools on what seems to be random port numbers, the first timeout was port 4079, the next was port 3368, the next was 3045. A different port number for each connection attempt. IBM support have directed me to try version 8.1 respin 2, the second rebuilt of the 8.1 release. It's apparently got a different version of the java engine. I've installed it and got the same error.

How do you make sure DataStage is using the Java that is in the InformationServer directory and not a different Java, such as the one in Windows/System32?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Umm.. CLASSPATH ?

I have a vague feeling that there's also an APT... environment variable, but maybe that's just for the JRE.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply