All,
Our configuration file has 3 nodes. This file is being used in all our jobs. When I run a job, will it use all three nodes for its processing? or will it use 2 nodes and the remaining one for operating system processes?
Inputs are welcome!
Number of Nodes used by datastage
Moderators: chulett, rschirm, roy
-
karthi_gana
- Premium Member
- Posts: 729
- Joined: Tue Apr 28, 2009 10:49 pm
-
mobashshar
- Participant
- Posts: 91
- Joined: Wed Apr 20, 2005 7:59 pm
- Location: U.S.
It will use all nodes within the configuration file, depending upon the file and the job design.
Stages running in sequential mode will run on only one node regardless of the number of nodes defined in the config file. Stages constrained to certain nodes or node pools will run only on those nodes or node pool member nodes. Stages that are not constrained and are running in parallel mode will run on nodes which are members of the default node pool.
Pools are documented in the Parallel Job Developer's Guide section on the Configuration File.
DataStage does not typically control where "operating system processes" run unless you are calling external programs/commands/scripts specifically within the job or sequence.
Regards,
Stages running in sequential mode will run on only one node regardless of the number of nodes defined in the config file. Stages constrained to certain nodes or node pools will run only on those nodes or node pool member nodes. Stages that are not constrained and are running in parallel mode will run on nodes which are members of the default node pool.
Pools are documented in the Parallel Job Developer's Guide section on the Configuration File.
DataStage does not typically control where "operating system processes" run unless you are calling external programs/commands/scripts specifically within the job or sequence.
Regards,
- james wiles
All generalizations are false, including this one - Mark Twain.
All generalizations are false, including this one - Mark Twain.