7.5.2 Windows to 8.1 Linux Performance Discrepancy
Moderators: chulett, rschirm, roy
7.5.2 Windows to 8.1 Linux Performance Discrepancy
We are moving from Windows to Linux and from DS Server 7.5.2 to 8.1. We have a simple job that reads a sequential file and loads an ODBC stage. The Wintel servers are 5+ years old. The Linux server is a SUSE VM on our IBM z10. The performance on the Linux/8.1 server is not good despite all indications of the server having more than enough resources: RAM, CPU, I/O and network.
# of ------- |-------------- | ------------ | Average -- | Records
Records -- | DataStage | Database | Processing | per
Processed | Host ------ | Host ------ | Time ------- | Second
----------------------------------------------------------------------
739,837 | Win01 | Win02 | 14.5 min. | 850.4
739,837 | Win01 | Linux01 | 40.8 min. | 302.2
739,837 | Linux01 | Linux01 | 35.5 min. | 347.3
739,837 | Linux01 | Win02 | 38.7 min. | 318.6
Has anyone had a similar situation? Are we missing something? Is there a solution?
# of ------- |-------------- | ------------ | Average -- | Records
Records -- | DataStage | Database | Processing | per
Processed | Host ------ | Host ------ | Time ------- | Second
----------------------------------------------------------------------
739,837 | Win01 | Win02 | 14.5 min. | 850.4
739,837 | Win01 | Linux01 | 40.8 min. | 302.2
739,837 | Linux01 | Linux01 | 35.5 min. | 347.3
739,837 | Linux01 | Win02 | 38.7 min. | 318.6
Has anyone had a similar situation? Are we missing something? Is there a solution?
-
- Participant
- Posts: 91
- Joined: Wed Apr 20, 2005 7:59 pm
- Location: U.S.
-
- Premium Member
- Posts: 892
- Joined: Thu Oct 16, 2003 5:18 am
The hardware specifications are as follows:
Linux01 (VM on IBM z10)
-------------------------------------------
CPU: 2 vCPU model 2097 (z10)
Mem: 4096MB / 3071MB page (vdisk)
Net: 10Gb Ethernet
Disk: Ficon attached
Win01 - DataStage Host
------------------------------------------
CPU: 4 CPU AMD 285 (2.6GHz)
Mem: 4096MB / 2046MB pagefile
Net: 100Mb Ethernet
Disk: Direct attached
Win02 - Oracle Host
-----------------------------------------
CPU: 4 CPU AMD 285 (2.6GHz)
Mem: 4096MB / 2046MB pagefile
Net: 100Mb Ethernet
Disk: Direct attached
Thank you for your time!
Linux01 (VM on IBM z10)
-------------------------------------------
CPU: 2 vCPU model 2097 (z10)
Mem: 4096MB / 3071MB page (vdisk)
Net: 10Gb Ethernet
Disk: Ficon attached
Win01 - DataStage Host
------------------------------------------
CPU: 4 CPU AMD 285 (2.6GHz)
Mem: 4096MB / 2046MB pagefile
Net: 100Mb Ethernet
Disk: Direct attached
Win02 - Oracle Host
-----------------------------------------
CPU: 4 CPU AMD 285 (2.6GHz)
Mem: 4096MB / 2046MB pagefile
Net: 100Mb Ethernet
Disk: Direct attached
Thank you for your time!
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
No, it's mainly about there being a radically different architecture. Version 8 is totally a service-oriented architecture, whereas version 7 is not. There's a lot more happening to support DataStage (the rest of the Information Server suite) in version 8, all of which consume some resources. The price of progress!
Last edited by ray.wurlod on Mon Nov 22, 2010 7:59 pm, edited 1 time in total.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Actually there's another impact on server jobs, that they have to interact with the parallel engine (and therefore data have to be converted from typeless to typed or vice versa when things like process metadata are being collected).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: