Master Apache JMeter – From Load Testing to DevOps.

Cover
FM
Copyright
Table of Contents
Preface
Chapter 1: Quick Start with JMeter
	Our Process
	Setup JMeter to Record Our Browsing Session
	Configure Your Browser
	Save Our Script
	Validate Our Script with Only One User
	Setup Our Load Test and Launch It
	Run Our Load Test and Analyze It
Chapter 2: JMeter Overview
	JMeter Overview
	Types of Load Tests Supported
	Supported Test Protocols
	Reporting
Chapter 3: Designing a Test Case
	Introduction
	Warning
	Type of Load Test
		Performance/Load Test
		Stress Test
		Soak/Endurance Test
		Failover/Resilience Test
		Spike Test
		Other
	Load Model
		Concurrency User (Closed Model)
		Throughput (Open Model)
		Arrivals Rate (Open Model)
	Structure of a Test Case
		Ramp-Up
		Plateau/Step
		Ramp-Down
		Example: Step Load Test
	Identify Critical Business Scenarios to Script
		Frequent
		Vital
		Risky
	How Many Virtual Users Do I Need?
	Parameters to Take into Account when Creating a Scenario
		Vary User Input
		Reuse the Same Values
		Vary the Types of Users
		Vary and Adjust Think Times
		Adjust the Ramp-Up Time
		Adjust the Test Duration
		Error Handling
		User Connection Type
		Size of the Scenarios
		Meeting Point/Rendezvous
		Cookie Management
		Cache Management
	Conclusion
Chapter 4: Important Concepts in JMeter
	Scoping
	Elements' Execution Order
	How Timer Scope Works
		Rule 1: Timers Are Executed before Each Sampler in Their Scope
		Rule 2: If There Is More Than One Timer in the Scope, All the Timers Will Be Processed before the Sampler
		Controlling the Execution Order of Timers
	How Assertion Scope Works
		Rule 1: Assertions Are Executed after Each Sampler in Their Scope or to Parent Samplers
		Rule 2: Failed Assertions Cause the Failure of the Entire Transaction Controller
		Rule 3: Assertions Can Validate the Main Sample and/or the Sub-Samples
		Rule 4: Be Careful with Low-Performing Assertions
		Our Advice
	How Properties Differ from Variables
		How Properties Are Created
		How Variables Are Created
		How ${} Differs from ${_P}
Chapter 5: Preparing the Test Environment (Injectors and Tested Systems)
	Introduction
	Setting Up the Injectors
		Never Host Injectors on the Same Server as the Tested System
		Calibrating Your Test
		Monitoring Injectors
		IP Spoofing
		Using the Latest Version
		JMeter Memory Configuration
		Avoiding Load Testing behind a Proxy
	Preparation of the System under Test
		A Testing Environment
		An Environment Consistent with the Target
		Datasets
		Take into Account Calls to Third-Party Services
		Disabling Protection Systems
		Using Isolated Environments
		License Management
		Monitoring
	Conclusion
Chapter 6: Being Productive with JMeter
	Introduction
	Good Practices When Recording a Script
		Use the HTTP(S) Test Script Recorder Element
		BlazeMeter Chrome Extension
		Pre-Populating HTTP Request Defaults before Recording the Script
		Use Tools / Import from cURL
		Static Resources
		Using Timeouts
		Applying a Naming Convention to Transactions/Requests
		Global Assertion
		Reusing Script Parts
		Recording an HTTPS website
		Keyboard Shortcuts
	Debugging a script
		Using View Results Tree
		Capturing Errors
		Debug Sampler
		jp@gc - Dummy Sampler
		Log Viewer
		BlazeMeter's Step-by-Step Debugger
		The Old-Fashioned Way in the Console
		Using a Third-Party Tool
	Finalizing a Script
		Changing the Name of a Transaction According to a Parameter
		Sharing an Object between Different Thread Groups
		Getting the Most out of CSV Files
		Marking a Response as an Error
		Using a Regular Expression Extractor on Content with Spaces and Multiple Lines
		Executing an Action Based on the Status of the Previous One
		Adding Headers to Our HTTP Requests
		Waiting with While Controller
		The Right Extractor at the Right Time
		Handle Cookies
	Conclusion
Chapter 7: Load Testing a Website
	A Bit of Theory
	Setup with JMeter
	Methodology
	Put into Practice with JMeter
		Example 1: Simulate Realistic Load
		Example 2: Technical Tests with Byteman
		Example 3: Technical Tests with JProfiler
		Example 4: Tricking CAPTCHAs with a Java Request
	Conclusion
Chapter 8: Load Testing Web Services
	A Few Concepts
		REST (REpresentational State Transfer) Web Services
		WS-\* Web Services
	Setup with JMeter
	Methodology
	Practice with JMeter
		SOAP/XML-RPC Web Services
		REST Web Service: Discussion Forum
		REST Web Service: Customer Database
	Conclusion
Chapter 9: Load Testinga Database Server
	A Bit of Theory
	Methodology
	Setup with JMeter
	Putting Theory into Practice with JMeter
		Example 1: Load Test of a Database
		Example 2: Studying the Impact of Indexes on Performance
		Example 3: ETL
	Conclusion
Chapter 10: Load TestingMessage-Oriented Middleware (MOM) via JMS
	A Bit of Theory
		Asynchronous Messages
		Decoupling
		Back Pressure
		Communication Models
		What is a Message Composed of?
	Setup with JMeter
		Installing the MOM libraries
		The JMS Point-to-Point Element
		JMS Resources and JNDI Properties
		Publish/Subscribe
	Methodology
	Putting It into Practice with JMeter
		Example 1: Testing the Configuration of an MOM server with Point-to-Point Messaging
		Example 2: Testing the Performance of Our Consumer with JMS Publish/Subscribe
		Example 3: Testing the Configuration of an MOM Server with Publish/Subscribe
		Example 4: Testing Any MOM
	Conclusion
Chapter 11: Performinga Load Test
	Introduction
	Methodology
	Testing Your Script with the Graphical User Interface
	Running Your Test from the Command Line
	Running Your Test on the Command Line with Taurus
	Running Your Test from Apache Maven
	Running Your Test from Jenkins
	Running Your Test from Apache Ant
	Best Practices
		Have Well-Prepared Injectors
		Generating Reports at the End of the Test
Chapter 12: Visualizing and Analyzing the Load Testing Results
	Introduction
	Visualizing the Results with Listeners
		View Results Tree
		Summary Report
		Aggregate Report
		Backend Listener
		Report Dashboard
		Particularities of the Visualization of Results a Distributed Load Test before JMeter 5.0
	Visualizing the Results with Third Party Visualizing Tools
	Visualizing the Results with PaaS Load Testing tools
		Redline13
		BlazeMeter
	Some Tips to Read the Results
		Prefer Percentiles over Average
		Be Careful with Downsampling and Data Retention
		Be Careful with Metric Definition
		Be Careful with Response Time at the Beginning of the Load Test
		Don't Rely on the Metrics of a Short Load Test
		Check Response Time Distribution
	Some Tips to Present the Results
		Don't Average Percentiles
		Define the Number of Metrics to Display in a Time Series Line Graph
		Define the Resolution/Granularity of the Measures
		Don't Forget to Add Labels, Legends, and Units in Graphs
		Axis Forced 0
		Don't Use Pie Charts
		Prefer Bar Graphs When We Have Sparse Metrics
		Present Errors with Toplist
		Time Series Graphs and Single-Value Summaries
	Conclusion
Chapter 13: Integration of JMeter in the DevOpsTool Chain
	Introduction
	Organization/Team Topology
		Load Testing Team in Its Ivory Tower
		DevOps and Load Test Team Collaboration
		One Performance Tester Integrated on DevOps Team
		No Performance Tester
		Team of Evangelists Performance Testers
	Setting Up Shift-Left Strategy
		Modification in JMeter Script to Implement Shift-Left Strategy
	Integrating JMeter in Our Software Factory
		Example 1: Integrating with Jenkins Using Maven
		Example 2: Enhancing Integration with Jenkins Using Performance Plugin
	Automation
		Example 3: Non-Regression Testing of Memory Consumption with EJ JProfiler
		Example 4: Detecting a Memory Leak during an Endurance Test with EJ JProfiler
		Example 5: Retrieving SQL Queries Executed during a Load Test with YourKit Java Profiler
		Example 6: Analysis of the Garbage Collector (GC) Log File with GCViewer
		Example 7: Non-Regression Testing of Web APIs with Dynatrace AppMon
	Conclusion
Index