DataStage Server performance very slow on vmware

RK72 · Post by **RK72** » Mon Oct 04, 2010 1:25 pm

DataStage 8.1 is installed on Windows 2003 server on vmware with 16 GB Ram and 4 Cpu's.Even after such a good resources the DataStage server is very slow and websphere is occupying almost 13 GB out of 16 GB even though none of the job is being ran.The jobs are very slow and if two users try to connect it hangs.Any suggestions of how to overcome this,how to improve the performance and how to find the memory leaks exactly.Any patches to install which will fix this.we already installed fp1 and fp3.

bmarko22 · Post by **bmarko22** » Mon Oct 04, 2010 2:05 pm

I was told DataStage does not work well with virtualization in general.

kduke · Post by **kduke** » Mon Oct 04, 2010 2:28 pm

DataStage is a resource hog. It can consume all the CPUs and RAM you throw at it. I do not recommend running under vmware.

RK72 · Post by **RK72** » Mon Oct 04, 2010 2:53 pm

Its a client requirement there standards are to run everything on vmware only.Any suggestions on how to improve the performance.

kduke · Post by **kduke** » Mon Oct 04, 2010 3:21 pm

Not sure how you could improve the performance. Sort of defeats the purpose of PX engine.

ray.wurlod · Post by **ray.wurlod** » Mon Oct 04, 2010 3:34 pm

Add more virtual memory (lots more- at least 4GB to the server, 8GB preferred, and at least 2GB to the client) to the VMWare images. If the underlying machine does not support that, get a higher-powered (more memory) underlying machine.

RK72 · Post by **RK72** » Mon Oct 04, 2010 3:40 pm

Its not about less RAM.Already 16 GB of RAM is allocated to it.We run the jobs on the server only so no client required.

Mike · Post by **Mike** » Mon Oct 04, 2010 3:49 pm

Is Windows 2003 Server the host OS or the guest OS or both? Is it 32-bit or 64-bit Windows?

Mike

IBM Analytics Champion 2009 - 2020 · Post by **asorrell** » Mon Oct 04, 2010 4:07 pm

Per this statement, IBM does provide limited support for VMWare - you might want to try calling your support provider and see if they also have suggestions:

http://www-01.ibm.com/support/docview.w ... f60074d175

RK72 · Post by **RK72** » Mon Oct 04, 2010 4:15 pm

Thank you I'll try talking to IBM support and see what they say.

ray.wurlod · Post by **ray.wurlod** » Mon Oct 04, 2010 6:33 pm

RK72 wrote:Its not about less RAM.Already 16 GB of RAM is allocated to it.We run the jobs on the server only so no client required.

Allocated in VMware?

myukassign · Post by **myukassign** » Mon Oct 04, 2010 7:43 pm

I am having 8.1 installed on VMWARE player. My server has got just 6 GB RAM. But it does well. Like ray suggested, my advice is also to increase the virtual memory size. It should do well.
My configuration is
Windows 2003 Server Enterprise
VMWARE player
8 GB RAM , VMWARE allocation is 6 GB
Virtual memory allocated to Windows server is close to 6 GB

Additionally do a watch of DB2 memory consumption, if your metadata repository is on the same server box. DB2 DBA can help in that case. A good performance tuning of DB2 also might help.

RK72 · Post by **RK72** » Mon Oct 11, 2010 8:19 pm

I have done system level tuning as suggested by IBM and it worked very well.

chulett · Post by **chulett** » Mon Oct 11, 2010 9:06 pm

Any chance you could let us know what 'system level tuning' IBM suggested?

RK72 · Post by **RK72** » Mon Oct 11, 2010 9:31 pm

http://www-01.ibm.com/support/docview.w ... wg21419242