Exercise 10 Performance Management

From wiki.gis.com
Jump to: navigation, search
System Architecture Design Strategies (select here for table of contents)
1. System Design Process 2. GIS Software Technology 3. Software Performance 4. Server Software Performance
5. GIS Data Administration 6. Network Communications 7. Platform Performance 8. Information Security
9. GIS Product Architecture 10. Performance Management 11. City of Rome 12. System Implementation

Rapid web service development and the availability of simple web service test tools are increasing the opportunity to use test measurements to generate custom workflow performance targets for use in planning.

The CPT Test tab was developed to translate measured test results to workflow service times that you can use to complete your system architecture design. This exercise will use simulated test results to create custom workflows that you will use to complete your system design.

Use the CPT to manage performance

In this exercise, you will perform the following tasks:

  • Use the CPT Calculator to generate simulated test results.
  • Use the CPT Test tab to translate measured test results to custom workflow performance targets.
  • Use the CPT Design tab to validate custom workflow performance targets.
  • Use the validated test workflow to complete a CPT Design using new 2018 servers.

Step 1: Convert measured test results to generate a custom project workflow

You can use the CPT Calculator to generate server utilization from a given load test. You will use the CPT Calculator throughput input and generated output to simulate measured test results.

  • Configure the CPT Calculator with the WebMap workflow recipe.
• Use the Calculator tab to configure the following workflow.
• WebMap_AGS REST 2D V Hvy 100%Dyn 13x7 PNG24 +$$
• User Requirements (throughput input): 36,000 TPH
• Platform Architecture: 3 tier, Minimum
• Hardware Platform Selection: 2013 Xeon E3-1270v2 4-core (1 chip) 3500 MHz
CPT Calculator is used to simulate a workflow benchmark.
SADS 06 10Ex01 19CPT0201.jpg


You will use an older 2013 platform to demonstrate that you can use older platform technology for benchmark performance testing. Make sure to use a production software configuration for best performance match.

• Client desktop: Intel Core i7-6700 4-core (1 chip) 3400 MHz

1. What is the throughput? _____ TPH

2. What is the measured utilization (WEB, SOC, DBMS)? ____, ____, ____ Percent

Step 2: Use the CPT Throughput/Utilization Test tool to generate workflow service times

  • Use the Test tab to insert the test results identified in step 1a.
• Throughput (TPH) = 36,000
• Web server = 2.7% utilization, 1 node, 2013 Xeon E3-1270v2 4-core (1 chip) 3500 MHz server
• SOC machine = 64.2% utilization, 1 node, 2013 Xeon E3-1270v2 4-core (1 chip) 3500 MHz server
• DB machine = 11.0% utilization, 1 node, 2013 Xeon E3-1270v2 4-core (1 chip) 3500 MHz server
CPT Test tab can be used to convert throughput and utililization to workflow service times.
SADS 06 10Ex02 19CPT0201.jpg


3. What are the Arc18 software component service times (client, web, SOC, DBMS)? ____, ____, ____, ____ sec

Step 3: Move the test workflow results to the Project Workflows list

After you provide your measured values in the CPT Test tab, the resulting service times are copied to the Test Workflows section at the bottom of the Workflow tab.

  • On the CPT Test tab Throughput/Utilization tool, insert the test results from step 1.
  • On the CPT Workflow tab, identify the WebMap_AGS REST 2D V Hvy 100%Dyn 13x7 PNG24 +$$ project workflow.
  • Copy the existing workflow to create a template, and insert the copied cells below WebMap workflow.
Warning: Select the row before using copy and insert commands.
  • Select and copy the light blue cells below Test Workflows, located at the bottom of the worksheet.
  • In column A of the new workflow template, select a cell and paste special values to insert the test workflow.
  • Label the new workflow Test Workflow_WebMap Validation Test.
SADS 06 10Ex03 19CPT0201.jpg


4. Do the test workflow results fall within the performance targets established for the WebMap workflow? Yes___ No___

5. What is the total service time for the test workflow? _____sec

Step 4: Validate the new test workflow on the CPT Design tab

Best practice: Use the Copy Sheet command to save a copy of the Design tab, and label the new copy 10.6-7 (Lesson 10, questions 6-7).
  • Configure the CPT Design tab to represent the test configuration.
• Three-tier platform architecture (web, GIS, DBMS).
• Set LAN bandwidth at 1000 Mbps.
• In column B, select Xeon 2013 Xeon E3-1270v4 4-core (1 chip) 3500 MHz server platforms and Intel Core i7-6700 client workstation.
• In the Requirements Analysis module, select Test Workflow and insert 36,000 TPH. Test workflow generated on the CPT Design tab validates platform utilization values.
SADS 06 10Ex04 19CPT0201.jpg


6. What is the platform utilization profile (WEB, GIS, DBMS)? ____, ____, ____ Percent

7. Does this utilization profile match what was provided in the Test tool? Yes___ No___

Step 5: Use the validated test workflow to generate capacity of new 2018 servers

Best practice: Use the Copy Sheet command to save a copy of the 10.6-7 Design tab, and label the new copy 10.8 (Lesson 10, question 8).
  • Use the validated test workflow to generate loads on your new platform.
• In column B, select Xeon Gold 5122 4 core (1 chip) 3600 MHz server platform.
• Select Intel Core i7-6700 client workstation.

CPT Design uses the validated test workflow to identified capacity of your selected design solution.

SADS 06 10Ex05 19CPT0201.jpg


8. What is the peak GIS platform throughput for the three-tier platform configuration (below the GIS platform tier in column G)? _____TPH

Answers to Lesson 10 questions

  • 1. What is the throughput? 36,000 TPH
  • 2. What is the measured utilization (web, SOC, DBMS)? 2.7%, 64.2%, 11.0%
  • 3. What are the Arc18 software component service times (client, web, SOC, DBMS)? 0.021 sec, 0.007 sec, 0.166 sec, 0.028 sec
  • 4. Do the test workflow results fall within the performance targets established for the WebMap workflow? Yes
  • 5. What is the total service time for the test workflow? 0.222 seconds
  • 6. What is the platform utilization profile (web, GIS, DBMS)? 2.7%, 64.2%, 11.0%
  • 7. Does this utilization profile match what was provided in the Test tool? Yes
  • 8. What is the peak GIS platform throughput for the three-tier platform configuration (below the GIS platform tier in column G)? 82,000 TPH

Lesson 10 CPT Exercise review

System Architecture Design Strategies (select here for table of contents)
1. System Design Process 2. GIS Software Technology 3. Software Performance 4. Server Software Performance
5. GIS Data Administration 6. Network Communications 7. Platform Performance 8. Information Security
9. GIS Product Architecture 10. Performance Management 11. City of Rome 12. System Implementation