CPT Virtualization Model 40th Edition

From wiki.gis.com
Jump to: navigation, search
System Design Strategies (select here for table of contents)
System Design Strategies 40th Edition (Spring 2017)
1. System Design Process 40th Edition 2. GIS Software Technology 40th Edition 3. Software Performance 40th Edition 4. Server Software Performance 40th Edition
5. GIS Data Administration 40th Edition 6. Network Communications 40th Edition 7. Platform Performance 40th Edition 8. Information Security 40th Edition
9. GIS Product Architecture 40th Edition 10. Performance Management 40th Edition 11. City of Rome 40th Edition 12. System Implementation 40th Edition
A1. Capacity Planning Tool 40th Edition B1. Windows Memory Management 40th Edition Preface (Executive Summary) 40th Edition SDSwiki What's New 40th Edition



CPT ArcGIS for Server Virtualization Model Changes 40th Edition

ArcGIS software deployment on virtual server platforms has become standard for most IT departments. This article provides background on updates to the Esri capacity planning models (introduced at the Arc15CapacityPlanning0101 release) implemented to support planning for ArcGIS for Server deployments in virtual server environments.

Past CPT Virtualization Models

Figure C-1.1 July 2015 Arc15CapacityPlanning0715 model comparing virtual vs physical ArcGIS for Server site performance and scalability.

Performance and scalability of ArcGIS for Server capacity planning models in virtualized environments was initially established from Esri joint testing with VMware with results published in an Esri ArcGIS Server 10 for VMware Infrastructure deployment and technical considerations guide in January 2011.

Results from the initial VMware testing showed virtual server machine (VM) hypervisor overhead loads increasing based on the number of VM core. Multiple smaller VMs would provide more throughput than one single high capacity VM with the same number of core.

Esri capacity planning models were developed based on the benchmark test results representing the performance profile shown in Figure C-1.1. Arc15CapacityPlanning0715 CPT results are generated using 2013 platform technology in order to compare results between benchmarks discussed later in this paper.

  • Physical server configuration
- Xeon X5650 12 core (2 chip) 2667 MHz platform (SRint2006=26.5/core)
- 4-core disabled for test purposes (8-core active)
  • Virtual server configurations
- Host platform: Xeon X5650 12 core (2 chip) 2667 MHz platform (SRint2006=26.5/core)
- Four virtual server machine configurations, each with total of 8 core.
  • Eight 1-core VMs
  • Four 2-core VMs
  • Two 4-core VMs
  • One 8-core VM
  • Performance results
- Physical 8-core server provided highest throughput = 55.6
- Virtual Server VM peak throughput
  • Eight 1-core VMs = 50.4
  • Four 2-core VMs = 50.4
  • Two 4-core VMs = 46.3
  • One 8-core VM = 42.8
- Multiple smaller VMs provided higher peak throughput
- Virtual Server VM peak throughput with a 12-core host platform configuration provided the same results as the 8-core host platform.
  • Model was based on hypervisor loads supporting the virtual server machines.
  • Hypervisor load did not leverage the additional host platform core.

New CPT Virtualization Models

Figure C-1.1 July 2013 ArcGIS 10.2 for Server VMware vSphere benchmark test results.

Esri conducted a new benchmark test with VMware in 2013 to evaluate technology advances with the new virtualization environments. A new ArcGIS for Server 10.1 and 10.2 VMware vSphere Deployment Guide was published sharing the benchmark results.

Results of the 2013 benchmark showed a different performance profile than the earlier testing. VMware recommended a new test configuration, where extra host platform processor resources were reserved for hypervisor processing overhead. As a result, the virtual server VM processing loads were able to match the physical server processing loads with the same number of core (test results did not show the hypervisor processing overhead).

Figure C-1.2 shows the results of the 2013 benchmarks. The Xeon X5650 platform technology was used in the 2013 testing.

  • Physical server configuration
- Xeon X5650 12 core (2 chip) 2667 MHz platform (SRint2006=26.5/core)
- 4-core disabled for test purposes (8-core active)
  • Virtual server configurations
- Host platform: Xeon X5650 12 core (2 chip) 2667 MHz platform (SRint2006=26.5/core)
- Four virtual server machine configurations, each with total of 8 core.
  • Eight 1-core VMs
  • Four 2-core VMs
  • Two 4-core VMs
  • One 8-core VM
  • Performance results
- Physical 8-core server provided highest throughput = 57.4
- Virtual Server VM peak throughput
  • Eight 1-core VMs = 35.6
  • Four 2-core VMs = 43.5
  • Two 4-core VMs = 51.0
  • One 8-core VM = 57.4
- Single 8-core VM provided higher peak throughput.
  • 8-core VM matched throughput of 8-core physical server.
  • Hypervisor loads were not reflected in VM loads.
- Hypervisor loads were supported by extra 4 host platform core.

ArcGIS for Server Site communication overhead

ArcGIS 10.1 for Server deployment introduced a new GIS Server Site architecture. This new architecture included a new site aware service manager load balancing capability integrated with the ArcGIS for Server site deployment. This new capability simplified ArcGIS for Server site deployment and management, providing an adaptive ArcGIS for Server site capability that shared a common file based configuration store.

Results of the 2013 VMware test identified a performance overhead in supporting multi-machine ArcGIS for Server site configurations due to ArcGIS for Server site communications. The ArcGIS for Server site communications increased with the number of machines in the site, reducing peak transaction throughput from the multiple machine configurations.

Capacity Planning Tool virtualization performance model

Figure C-1.1 January 2016 Arc15CapacityPlanning0010 model calculating results of the 2013 VMware virtualization benchmark configuration.

The new CPT performance model introduced in January 2016 incorporates the updated VMware virtualization load distribution and the ArcGIS for Server site communication overhead loads reflected in the 2013 VMware benchmarks.

Figure C-1.3 shows the results of the 2013 benchmarks generated by the new CPT performance models. The Xeon X5650 platform technology was used in generating the CPT results.

  • Physical server configuration
- Xeon X5650 12 core (2 chip) 2667 MHz platform (SRint2006=26.5/core)
- 4-core disabled for test purposes (8-core active)
  • Virtual server configurations
- Host platform: Xeon X5650 12 core (2 chip) 2667 MHz platform (SRint2006=26.5/core)
- Four virtual server machine configurations, each with total of 8 core.
  • Eight 1-core VMs
  • Four 2-core VMs
  • Two 4-core VMs
  • One 8-core VM
  • Performance results
- Physical 8-core server provided highest throughput = 57.4
- Virtual Server VM peak throughput
  • Eight 1-core VMs = 35.6
  • Four 2-core VMs = 43.5
  • Two 4-core VMs = 51.0
  • One 8-core VM = 57.4
- Single 8-core VM provided higher peak throughput.
  • 8-core VM matched throughput of 8-core physical server.
  • Hypervisor loads were not reflected in VM loads.
- Hypervisor loads were supported by extra 4 host platform core.
  • Multiple VM throughput degradation is due to the GIS Server site internal communication loads.

Virtualization processing overhead

Figure C-1.1 January 2016 Arc15CapacityPlanning0010 model calculating results of the VMware vSphere virtualization benchmark configuration with all physical and virtual benchmarks using an 8-core server configuration.

The 2013 VMware virtualization benchmark showed ArcGIS for Server performance where an 8-core physical server provided the same throughput as an 8-core virtual server machine (VM), with all the virtualization processing overhead supported by 4 separate host platform processor core. The virtualization processing overhead was not measured in this benchmark – the results showed only the 8-core VM peak throughput and the 8-core physical peak throughput, and both were the same.

The 12-core host platform had 4-core that were not assigned to the 8-core VMs, and hypervisor processing loads were supported by those 4 extra host platform core. Additional internal testing was completed by Esri staff comparing throughput of an 8-core physical machine with an 8-core virtual machine with the same 8-core host platform. The physical machine configuration showed over 50 percent more throughput that the virtual machine configuration, suggesting that the virtualization overhead was roughly 50 percent of the loads generated by the virtual machines. The results of our internal test was consistent with what we saw in the VMware test – the virtualization overhead would not impact VM throughput if we reserve 4 extra core on the host platform for hypervisor processing.

Figure C-1.4 shows the results of an 8-core host platform supporting the 8-core VM configurations. 8-core physical machine was used for the physical throughput benchmark. These results were generated by the new January 2016 CPT performance models. The Xeon X5650 platform technology was used in generating the CPT results.

  • Physical server configuration
- Xeon X5650 12 core (2 chip) 2667 MHz platform (SRint2006=26.5/core)
- 4-core disabled for test purposes (8-core active)
  • Virtual server configurations
- Host platform: Xeon X5650 12 core (2 chip) 2667 MHz platform (SRint2006=26.5/core)
- 4-core disabled for test purposes (8-core active)
- Four virtual server machine configurations, each with total of 8 core.
  • Eight 1-core VMs
  • Four 2-core VMs
  • Two 4-core VMs
  • One 8-core VM
  • Performance results
- Physical 8-core server provided highest throughput = 57.4
- Virtual Server VM peak throughput
  • Eight 1-core VMs = 26.4
  • Four 2-core VMs = 31.1
  • Two 4-core VMs = 35.2
  • One 8-core VM = 38.3
- Single 8-core VM provided higher peak throughput.
  • 8-core VM matched throughput of 8-core physical server.
  • Hypervisor loads are reflected by the VM throughput loss.
- 8-core VM peak throughput 33 percent less than 8-core physical server.
- Reduced VM throughput was due to virtualization load contention.
  • Multiple VM throughput degradation is due to the GIS Server site internal communication loads.
- Single 8-core VM machine provides highest VM throughput.

Conclusion

New CPT models provide more accurate capacity planning for virtualization deployments. Virtualization overhead is conservative, and consistent with the benchmark results and deployment recommendations provided in the ArcGIS for Server 10.1 and 10.2 VMware Deployment Guide.

Virtualization load profiles can change with new technology releases. New virtualization technology releases should reduce virtualization overhead and improve ArcGIS for Server throughput. CPT models can be adjusted to reflect reduced virtualization overhead when appropriate.

System Design Strategies (select here for table of contents)
System Design Strategies 40th Edition (Spring 2017)
1. System Design Process 40th Edition 2. GIS Software Technology 40th Edition 3. Software Performance 40th Edition 4. Server Software Performance 40th Edition
5. GIS Data Administration 40th Edition 6. Network Communications 40th Edition 7. Platform Performance 40th Edition 8. Information Security 40th Edition
9. GIS Product Architecture 40th Edition 10. Performance Management 40th Edition 11. City of Rome 40th Edition 12. System Implementation 40th Edition
A1. Capacity Planning Tool 40th Edition B1. Windows Memory Management 40th Edition Preface (Executive Summary) 40th Edition SDSwiki What's New 40th Edition


Page Footer
Specific license terms for this content
System Design Strategies 26th edition - An Esri ® Technical Reference Document • 2009 (final PDF release)