Dear All,
Need some information about datastage configuration file.
We have 2 DS+QS engine . Engine 1 containing 10 core(CPU) and engine 2 containing 9 core (CPU) with 40 gb ram on each server.
While running job what configuration file we have create so that we can take the advantages of processing of both server .
Basically my configuration sample file as follows:
{
node "node1"
{
fastname "Engine1"
pools ""
resource disk "/resource1" {pools ""}
resource scratchdisk "/scratch1" {pools ""}
}
node "node2"
{
fastname "Engine2"
pools ""
resource disk "/resource2" {pools ""}
resource scratchdisk "/scratch2" {pools ""}
}
}
Can anybody explain me configuration file wrt to cpu (10 +9 CPU)
Thanks.
Datastage configuration file
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 353
- Joined: Mon Jan 17, 2011 5:03 am
- Location: Mumbai, India
Datastage configuration file
Thanx and Regards,
ETL User
ETL User
-
- Premium Member
- Posts: 353
- Joined: Mon Jan 17, 2011 5:03 am
- Location: Mumbai, India
Means that I can use following combination.arvind_ds wrote:You can start with below.
No of nodes = Half the number of cores.
10 cpu =20 Nodes and 9 cpu =18 nodes.
So can I use 20 +18=38 nodes for loading data ? or It can hampered the performance while using 38 nodes. How can I get the information that how many nodes I have to use for a perticular job ?
Thanks
Thanx and Regards,
ETL User
ETL User
That depends on the complexity of the jobs that you run. If you have the grid version of the InfoSphere then its taken care of by the resource manager. Else you have to use different configuration files based on the complexity of the job.
From your explanation it sounds like an SMP cluster. Checkout the link below. It may help you further.
http://publib.boulder.ibm.com/infocente ... n_SMP.html
From your explanation it sounds like an SMP cluster. Checkout the link below. It may help you further.
http://publib.boulder.ibm.com/infocente ... n_SMP.html
Chanaka Wagoda
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
No it doesn't. It meanschandra.shekhar@tcs.com wrote:Means that I can use following combination.arvind_ds wrote:You can start with below.
No of nodes = Half the number of cores.
10 cpu =20 Nodes and 9 cpu =18 nodes.
10 cpu = 5 nodes and 9 cpu = 5 nodes.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.