Exercise 10 Performance Management
Rapid web service development and the availability of simple web service test tools are increasing the opportunity to use test measurements to generate custom workflow performance targets for use in planning.
The CPT Test tab was developed to translate measured test results to workflow service times that you can use to complete your system architecture design. This exercise will use simulated test results to create custom workflows that you will use to complete your system design.
Contents
- 1 Use the CPT to manage performance
- 1.1 Step 1: Convert measured test results to generate a custom project workflow
- 1.2 Step 2: Use the CPT Throughput/Utilization Test tool to generate workflow service times
- 1.3 Step 3: Move the test workflow results to the Project Workflows list
- 1.4 Step 4: Validate the new test workflow on the CPT Design tab
- 1.5 Step 5: Use the validated test workflow to generate capacity of new 2018 servers
- 2 Answers to Lesson 10 questions
Use the CPT to manage performance
In this exercise, you will perform the following tasks:
- Use the CPT Calculator to generate simulated test results.
- Use the CPT Test tab to translate measured test results to custom workflow performance targets.
- Use the CPT Design tab to validate custom workflow performance targets.
- Use the validated test workflow to complete a CPT Design using new 2018 servers.
Step 1: Convert measured test results to generate a custom project workflow
You can use the CPT Calculator to generate server utilization from a given load test. You will use the CPT Calculator throughput input and generated output to simulate measured test results.
- Configure the CPT Calculator with the WebMap workflow recipe.
- • Use the Calculator tab to configure the following workflow.
- • WebMap_AGS REST 2D V Hvy 100%Dyn 13x7 PNG24 +$$
- • User Requirements (throughput input): 36,000 TPH
- • Platform Architecture: 3 tier, Minimum
- • Hardware Platform Selection: 2013 Xeon E3-1270v2 4-core (1 chip) 3500 MHz
- CPT Calculator is used to simulate a workflow benchmark.
You will use an older 2013 platform to demonstrate that you can use older platform technology for benchmark performance testing. Make sure to use a production software configuration for best performance match.
- • Client desktop: Intel Core i7-6700 4-core (1 chip) 3400 MHz
1. What is the throughput? _____ TPH
2. What is the measured utilization (WEB, SOC, DBMS)? ____, ____, ____ Percent
Step 2: Use the CPT Throughput/Utilization Test tool to generate workflow service times
- Use the Test tab to insert the test results identified in step 1a.
- • Throughput (TPH) = 36,000
- • Web server = 2.7% utilization, 1 node, 2013 Xeon E3-1270v2 4-core (1 chip) 3500 MHz server
- • SOC machine = 64.2% utilization, 1 node, 2013 Xeon E3-1270v2 4-core (1 chip) 3500 MHz server
- • DB machine = 11.0% utilization, 1 node, 2013 Xeon E3-1270v2 4-core (1 chip) 3500 MHz server
- CPT Test tab can be used to convert throughput and utililization to workflow service times.
3. What are the Arc18 software component service times (client, web, SOC, DBMS)? ____, ____, ____, ____ sec
Step 3: Move the test workflow results to the Project Workflows list
After you provide your measured values in the CPT Test tab, the resulting service times are copied to the Test Workflows section at the bottom of the Workflow tab.
- On the CPT Test tab Throughput/Utilization tool, insert the test results from step 1.
- On the CPT Workflow tab, identify the WebMap_AGS REST 2D V Hvy 100%Dyn 13x7 PNG24 +$$ project workflow.
- Copy the existing workflow to create a template, and insert the copied cells below WebMap workflow.
Warning: Select the row before using copy and insert commands.
- Select and copy the light blue cells below Test Workflows, located at the bottom of the worksheet.
- In column A of the new workflow template, select a cell and paste special values to insert the test workflow.
- Label the new workflow Test Workflow_WebMap Validation Test.
4. Do the test workflow results fall within the performance targets established for the WebMap workflow? Yes___ No___
5. What is the total service time for the test workflow? _____sec
Step 4: Validate the new test workflow on the CPT Design tab
Best practice: Use the Copy Sheet command to save a copy of the Design tab, and label the new copy 10.6-7 (Lesson 10, questions 6-7).
- Configure the CPT Design tab to represent the test configuration.
- • Three-tier platform architecture (web, GIS, DBMS).
- • Set LAN bandwidth at 1000 Mbps.
- • In column B, select Xeon 2013 Xeon E3-1270v4 4-core (1 chip) 3500 MHz server platforms and Intel Core i7-6700 client workstation.
- • In the Requirements Analysis module, select Test Workflow and insert 36,000 TPH. Test workflow generated on the CPT Design tab validates platform utilization values.
6. What is the platform utilization profile (WEB, GIS, DBMS)? ____, ____, ____ Percent
7. Does this utilization profile match what was provided in the Test tool? Yes___ No___
Step 5: Use the validated test workflow to generate capacity of new 2018 servers
Best practice: Use the Copy Sheet command to save a copy of the 10.6-7 Design tab, and label the new copy 10.8 (Lesson 10, question 8).
- Use the validated test workflow to generate loads on your new platform.
- • In column B, select Xeon Gold 5122 4 core (1 chip) 3600 MHz server platform.
- • Select Intel Core i7-6700 client workstation.
CPT Design uses the validated test workflow to identified capacity of your selected design solution.
8. What is the peak GIS platform throughput for the three-tier platform configuration (below the GIS platform tier in column G)? _____TPH
Answers to Lesson 10 questions
- 1. What is the throughput? 36,000 TPH
- 2. What is the measured utilization (web, SOC, DBMS)? 2.7%, 64.2%, 11.0%
- 3. What are the Arc18 software component service times (client, web, SOC, DBMS)? 0.021 sec, 0.007 sec, 0.166 sec, 0.028 sec
- 4. Do the test workflow results fall within the performance targets established for the WebMap workflow? Yes
- 5. What is the total service time for the test workflow? 0.222 seconds
- 6. What is the platform utilization profile (web, GIS, DBMS)? 2.7%, 64.2%, 11.0%
- 7. Does this utilization profile match what was provided in the Test tool? Yes
- 8. What is the peak GIS platform throughput for the three-tier platform configuration (below the GIS platform tier in column G)? 82,000 TPH