Page 1 of 1

DataStage Server performance very slow on vmware

Posted: Mon Oct 04, 2010 1:25 pm
by RK72
DataStage 8.1 is installed on Windows 2003 server on vmware with 16 GB Ram and 4 Cpu's.Even after such a good resources the DataStage server is very slow and websphere is occupying almost 13 GB out of 16 GB even though none of the job is being ran.The jobs are very slow and if two users try to connect it hangs.Any suggestions of how to overcome this,how to improve the performance and how to find the memory leaks exactly.Any patches to install which will fix this.we already installed fp1 and fp3.

Posted: Mon Oct 04, 2010 2:05 pm
by bmarko22
I was told DataStage does not work well with virtualization in general.

Posted: Mon Oct 04, 2010 2:28 pm
by kduke
DataStage is a resource hog. It can consume all the CPUs and RAM you throw at it. I do not recommend running under vmware.

Posted: Mon Oct 04, 2010 2:53 pm
by RK72
Its a client requirement there standards are to run everything on vmware only.Any suggestions on how to improve the performance.

Posted: Mon Oct 04, 2010 3:21 pm
by kduke
Not sure how you could improve the performance. Sort of defeats the purpose of PX engine.

Posted: Mon Oct 04, 2010 3:34 pm
by ray.wurlod
Add more virtual memory (lots more- at least 4GB to the server, 8GB preferred, and at least 2GB to the client) to the VMWare images. If the underlying machine does not support that, get a higher-powered (more memory) underlying machine.

Posted: Mon Oct 04, 2010 3:40 pm
by RK72
Its not about less RAM.Already 16 GB of RAM is allocated to it.We run the jobs on the server only so no client required.

Posted: Mon Oct 04, 2010 3:49 pm
by Mike
Is Windows 2003 Server the host OS or the guest OS or both? Is it 32-bit or 64-bit Windows?

Mike

Posted: Mon Oct 04, 2010 4:07 pm
by asorrell
Per this statement, IBM does provide limited support for VMWare - you might want to try calling your support provider and see if they also have suggestions:

http://www-01.ibm.com/support/docview.w ... f60074d175

Posted: Mon Oct 04, 2010 4:15 pm
by RK72
Thank you I'll try talking to IBM support and see what they say.

Posted: Mon Oct 04, 2010 6:33 pm
by ray.wurlod
RK72 wrote:Its not about less RAM.Already 16 GB of RAM is allocated to it.We run the jobs on the server only so no client required.
Allocated in VMware?

Posted: Mon Oct 04, 2010 7:43 pm
by myukassign
I am having 8.1 installed on VMWARE player. My server has got just 6 GB RAM. But it does well. Like ray suggested, my advice is also to increase the virtual memory size. It should do well.
My configuration is
Windows 2003 Server Enterprise
VMWARE player
8 GB RAM , VMWARE allocation is 6 GB
Virtual memory allocated to Windows server is close to 6 GB

Additionally do a watch of DB2 memory consumption, if your metadata repository is on the same server box. DB2 DBA can help in that case. A good performance tuning of DB2 also might help.

Posted: Mon Oct 11, 2010 8:19 pm
by RK72
I have done system level tuning as suggested by IBM and it worked very well.

Posted: Mon Oct 11, 2010 9:06 pm
by chulett
Any chance you could let us know what 'system level tuning' IBM suggested?

Posted: Mon Oct 11, 2010 9:31 pm
by RK72