Version 8- Does it need more resources for the dev server?
Moderators: chulett, rschirm, roy
Version 8- Does it need more resources for the dev server?
We had IBM consultant at our site and he suggested that we should have eight processor server for DataStage development server and four process server for DataStage production server. His argument is because of new architecture, development server needs more resources.
I am not very convinced with his argument. I thought I should ask experts here at the forum, who has version 8 installed at their site and are using it.
Thanks,
Dinesh
I am not very convinced with his argument. I thought I should ask experts here at the forum, who has version 8 installed at their site and are using it.
Thanks,
Dinesh
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Without knowing why that recommendation was made, it's impossible to comment. Can you please ask the IBM consultant why that recommendation was made? For example do you have many developers, do you use the same machine for development and testing?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Ray,
We are going to have 10 to 15 developers, some will be onsite and some will be offshore for DataStage job development. IBM consultants argument is, each developer will be taking resources on the server and in order to provide better development environment, eight processor server is needed.
We will have a separate server for testing and production.
Thanks,
Dinesh
We are going to have 10 to 15 developers, some will be onsite and some will be offshore for DataStage job development. IBM consultants argument is, each developer will be taking resources on the server and in order to provide better development environment, eight processor server is needed.
We will have a separate server for testing and production.
Thanks,
Dinesh
Odd as this may seem, I am almost in agreement with Dinesh and the consultant. IBM has told us that the Development Client tools should not be run with less than 3 GB of RAM available. It is also quite apparent from our experience thus far with V8, that the Dev box needs to be very beefy due to the total number of connections and test runs that developers will be making.
Production should not be have client GUI client connections occuring in general other than Admin, so the resources are going to be primarily devoted to doing the work of production. I don't know that I would flip the configuration as was suggested, but I can certainly see making the Dev box equivalent to the Prod box if possible to handle the extra load.
So far, we are finding V8 to be a dog on performance (V7 currently runs 4 times faster for my project) and the multi-instance jobs with auto-purge of logs bug is a literal show stopper (there is a patch).
Just my 2 cents worth.
Production should not be have client GUI client connections occuring in general other than Admin, so the resources are going to be primarily devoted to doing the work of production. I don't know that I would flip the configuration as was suggested, but I can certainly see making the Dev box equivalent to the Prod box if possible to handle the extra load.
So far, we are finding V8 to be a dog on performance (V7 currently runs 4 times faster for my project) and the multi-instance jobs with auto-purge of logs bug is a literal show stopper (there is a patch).
Just my 2 cents worth.
Bestest!
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
-
- Charter Member
- Posts: 193
- Joined: Tue Sep 05, 2006 8:01 pm
- Location: Australia
There is evidently another step that has to be done as well. I don't know if you did it, but here are the instructions as plucked from an email chain between our DataStage admins:
I don't know if that will help at all, but I hope it does.Go to project properties, general tab, click on environment, click on user defined, right click uner details, add new cell, enter the info below.
name=DS_NO_INSTANCE_PURGING type=string prompt=no instance purge value=1
Bestest!
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
I can relate. That is known as the 'addition of undocumented features.'
Don't you know that is a good thing!
Don't you know that is a good thing!
Bestest!
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services
"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
...to the original question, regarding size of the (engine) machine, it's often the case that the development machine may need to be bigger than the production machine. This is especially true when simultaneous developers are building, compiling and testing concurrent parallel jobs ---- Jobs that at production run-time may run serially in a Sequence. Even a single developer will often run multiple Jobs during testing that otherwise might not run concurrently. Server Jobs are no exception from this, but of course parallel Jobs will potentially spin up a lot more processes depending on the complexity of the Job and the degree of parallelism.
Ernie
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
-
- Premium Member
- Posts: 87
- Joined: Sat Jul 14, 2007 2:24 pm
Hi alljdmiceli wrote:There is evidently another step that has to be done as well. I don't know if you did it, but here are the instructions as plucked from an email chain between our DataStage admins:
I don't know if that will help at all, but I hope it does.Go to project properties, general tab, click on environment, click on user defined, right click uner details, add new cell, enter the info below.
name=DS_NO_INSTANCE_PURGING type=string prompt=no instance purge value=1
We also install the patch 30015v3 in order to resolve the logs disappearance
After installing we encountered several bugs -
Synchronization error
Parameter transfer between sequence and job fails
Does anyone know of a solution ?