Prometheus: Up & Running: Infrastructure and Application Performance Monitoring

Copyright
Table of Contents
Preface
	Expanding the Known
	The Evolution of Prometheus
	Conventions Used in This Book
	Using Code Examples
	O’Reilly Online Learning
	How to Contact Us
	Acknowledgments
Part I. Introduction
	Chapter 1. What Is Prometheus?
		What Is Monitoring?
			A Brief and Incomplete History of Monitoring
			Categories of Monitoring
		Prometheus Architecture
			Client Libraries
			Exporters
			Service Discovery
			Scraping
			Storage
			Dashboards
			Recording Rules and Alerts
			Alert Management
			Long-Term Storage
		What Prometheus Is Not
	Chapter 2. Getting Started with Prometheus
		Running Prometheus
		Using the Expression Browser
		Running the Node Exporter
		Alerting
Part II. Application Monitoring
	Chapter 3. Instrumentation
		A Simple Program
		The Counter
			Counting Exceptions
			Counting Size
		The Gauge
			Using Gauges
			Callbacks
		The Summary
		The Histogram
			Buckets
		Unit Testing Instrumentation
		Approaching Instrumentation
			What Should I Instrument?
			How Much Should I Instrument?
			What Should I Name My Metrics?
	Chapter 4. Exposition
		Python
			WSGI
			Twisted
			Multiprocess with Gunicorn
		Go
		Java
			HTTPServer
			Servlet
		Pushgateway
		Bridges
		Parsers
		Text Exposition Format
			Metric Types
			Labels
			Escaping
			Timestamps
			check metrics
		OpenMetrics
			Metric Types
			Labels
			Timestamps
	Chapter 5. Labels
		What Are Labels?
		Instrumentation and Target Labels
		Instrumentation
			Metric
			Multiple Labels
			Child
		Aggregating
		Label Patterns
			Enum
			Info
		When to Use Labels
			Cardinality
	Chapter 6. Dashboarding with Grafana
		Installation
		Data Source
		Dashboards and Panels
			Avoiding the Wall of Graphs
		Time Series Panel
			Time Controls
		Stat Panel
		Table Panel
		State Timeline Panel
		Template Variables
Part III. Infrastructure Monitoring
	Chapter 7. Node Exporter
		CPU Collector
		Filesystem Collector
		Diskstats Collector
		Netdev Collector
		Meminfo Collector
		Hwmon Collector
		Stat Collector
		Uname Collector
		OS Collector
		Loadavg Collector
		Pressure Collector
		Textfile Collector
			Using the Textfile Collector
			Timestamps
	Chapter 8. Service Discovery
		Service Discovery Mechanisms
			Static
			File
			HTTP
			Consul
			EC2
		Relabeling
			Choosing What to Scrape
			Target Labels
		How to Scrape
			metric_relabel_configs
			Label Clashes and honor_labels
	Chapter 9. Containers and Kubernetes
		cAdvisor
			CPU
			Memory
			Labels
		Kubernetes
			Running in Kubernetes
			Service Discovery
			kube-state-metrics
		Alternative Deployments
	Chapter 10. Common Exporters
		Consul
		MySQLd
		Grok Exporter
		Blackbox
			ICMP
			TCP
			HTTP
			DNS
			Prometheus Configuration
	Chapter 11. Working with Other Monitoring Systems
		Other Monitoring Systems
		InfluxDB
		StatsD
	Chapter 12. Writing Exporters
		Consul Telemetry
		Custom Collectors
			Labels
		Guidelines
Part IV. PromQL
	Chapter 13. Introduction to PromQL
		Aggregation Basics
			Gauge
			Counter
			Summary
			Histogram
		Selectors
			Matchers
			Instant Vector
			Range Vector
			Subqueries
			Offset
			At Modifier
		HTTP API
			query
			query_range
	Chapter 14. Aggregation Operators
		Grouping
			without
			by
		Operators
			sum
			count
			avg
			group
			stddev and stdvar
			min and max
			topk and bottomk
			quantile
			count_values
	Chapter 15. Binary Operators
		Working with Scalars
			Arithmetic Operators
			Trigonometric Operator
			Comparison Operators
		Vector Matching
			One-to-One
			Many-to-One and group_left
			Many-to-Many and Logical Operators
		Operator Precedence
	Chapter 16. Functions
		Changing Type
			vector
			scalar
		Math
			abs
			ln, log2, and log10
			exp
			sqrt
			ceil and floor
			round
			clamp, clamp_max, and clamp_min
			sgn
			Trigonometric Functions
		Time and Date
			time
			minute, hour, day_of_week, day_of_month, day_of_year, days_in_month, month, and year
			timestamp
		Labels
			label_replace
			label_join
		Missing Series, absent, and absent_over_time
		Sorting with sort and sort_desc
		Histograms with histogram_quantile
		Counters
			rate
			increase
			irate
			resets
		Changing Gauges
			changes
			deriv
			predict_linear
			delta
			idelta
			holt_winters
		Aggregation Over Time
	Chapter 17. Recording Rules
		Using Recording Rules
		When to Use Recording Rules
			Reducing Cardinality
			Composing Range Vector Functions
			Rules for APIs
			How Not to Use Rules
		Naming of Recording Rules
Part V. Alerting
	Chapter 18. Alerting
		Alerting Rules
			for
			Alert Labels
			Annotations and Templates
			What Are Good Alerts?
		Configuring Alertmanagers in Prometheus
			External Labels
	Chapter 19. Alertmanager
		Notification Pipeline
		Configuration File
			Routing Tree
			Receivers
			Inhibitions
		Alertmanager Web Interface
Part VI. Deployment
	Chapter 20. Server-Side Security
		Security Features Provided by Prometheus
		Enabling TLS
		Advanced TLS Options
		Enabling Basic Authentication
	Chapter 21. Putting It All Together
		Planning a Rollout
		Growing Prometheus
		Going Global with Federation
		Long-Term Storage
		Running Prometheus
			Hardware
			Configuration Management
			Networks and Authentication
		Planning for Failure
			Alertmanager Clustering
			Meta- and Cross-Monitoring
		Managing Performance
			Detecting a Problem
			Finding Expensive Metrics and Targets
			Reducing Load
			Horizontal Sharding
		Managing Change
		Getting Help
Index
About the Authors
Colophon