DevOps: Puppet, Docker, and Kubernetes : get hands-on recipes to automate and manage Linux containers with the Docker 1.6 environment and jump-start your Puppet development

Cover......Page 1
Copyright......Page 3
Credits......Page 4
Preface......Page 6
Table of Content......Page 12
Module 1: Puppet Cookbook......Page 20
Chapter 1: Puppet Language and Style......Page 22
 Adding a resource to a node......Page 23
 Using Facter to describe a node......Page 24
 Installing a package before starting a service......Page 25
 Installing, configuring, and starting a service......Page 27
 Using community Puppet style......Page 29
 Creating a manifest......Page 32
 Checking your manifests with Puppet-lint......Page 34
 Using modules......Page 36
 Using standard naming conventions......Page 41
 Using inline templates......Page 43
 Iterating over multiple items......Page 44
 Writing powerful conditional statements......Page 47
 Using regular expressions in if statements......Page 49
 Using selectors and case statements......Page 51
 Using the in operator......Page 54
 Using regular expression substitutions......Page 55
 Using the future parser......Page 57
Chapter 2: Puppet Infrastructure......Page 62
 Installing Puppet......Page 63
 Managing your manifests with Git......Page 64
 Creating a decentralized Puppet architecture......Page 70
 Writing a papply script......Page 73
 Running Puppet from cron......Page 76
 Bootstrapping Puppet with bash......Page 79
 Creating a centralized Puppet infrastructure......Page 82
 Creating certificates with multiple DNS names......Page 84
 Running Puppet from passenger......Page 85
 Setting up the environment......Page 88
 Configuring PuppetDB......Page 91
 Configuring Hiera......Page 92
 Setting node-specific data with Hiera......Page 95
 Storing secret data with hiera-gpg......Page 96
 Using MessagePack serialization......Page 98
 Automatic syntax checking with Git hooks......Page 99
 Pushing code around with Git......Page 101
 Managing Environments with Git......Page 104
Chapter 3: Writing Better Manifests......Page 108
 Using arrays of resources......Page 109
 Using resource defaults......Page 110
 Using defined types......Page 113
 Using tags......Page 116
 Using run stages......Page 119
 Using roles and profiles......Page 123
 Passing parameters to classes......Page 125
 Passing parameters from Hiera......Page 127
 Writing reusable, cross-platform manifests......Page 128
 Getting information about the environment......Page 131
 Importing dynamic information......Page 133
 Passing arguments to shell commands......Page 135
Chapter 4: Working with Files and Packages......Page 138
 Making quick edits to config files......Page 139
 Editing INI style files with puppetlabs-inifile......Page 142
 Using Augeas to reliably edit config files......Page 145
 Building config files using snippets......Page 147
 Using ERB templates......Page 149
 Using array iteration in templates......Page 151
 Using EPP templates......Page 154
 Using GnuPG to encrypt secrets......Page 155
 Installing packages from a third-party repository......Page 161
 Comparing package versions......Page 164
 Introduction......Page 168
 Using virtual resources......Page 169
 Managing users with virtual resources......Page 173
 Managing users\' SSH access......Page 176
 Managing users\' customization files......Page 180
 Using exported resources......Page 183
Chapter 6: Managing Resources and Files......Page 188
 Distributing cron jobs efficiently......Page 189
 Scheduling when resources are applied......Page 193
 Using host resources......Page 196
 Using exported host resources......Page 197
 Using multiple file sources......Page 200
 Distributing and merging directory trees......Page 203
 Cleaning up old files......Page 207
 Auditing resources......Page 209
 Temporarily disabling resources......Page 210
 Introduction......Page 214
 Using public modules......Page 215
 Managing Apache servers......Page 217
 Creating Apache virtual hosts......Page 219
 Creating nginx virtual hosts......Page 223
 Managing MySQL......Page 226
 Creating databases and users......Page 228
 Introduction......Page 232
 Managing firewalls with iptables......Page 233
 Building high-availability services using Heartbeat......Page 239
 Managing NFS servers and file shares......Page 246
 Using HAProxy to load-balance multiple web servers......Page 255
 Managing Docker with Puppet......Page 261
Chapter 9: External Tools and the Puppet Ecosystem......Page 266
 Creating custom facts......Page 267
 Adding external facts......Page 270
 Setting facts as environment variables......Page 273
 Generating manifests with the Puppet resource command......Page 274
 Generating manifests with other tools......Page 276
 Using an external node classifier......Page 280
 Creating your own resource types......Page 283
 Creating your own providers......Page 286
 Creating custom functions......Page 288
 Testing your puppet manifests with rspec-puppet......Page 292
 Using librarian-puppet......Page 297
 Using r10k......Page 299
 Introduction......Page 304
 Noop – the don\'t change anything option......Page 305
 Logging command output......Page 308
 Logging debug messages......Page 310
 Generating reports......Page 312
 Producing automatic HTML documentation......Page 314
 Drawing dependency graphs......Page 317
 Understanding Puppet errors......Page 322
 Inspecting configuration settings......Page 325
Module 2: Docker Cookbook......Page 328
 Introduction......Page 330
 Verifying the requirements for Docker installation......Page 338
 Installing Docker......Page 339
 Pulling an image and running a container......Page 340
 Adding a nonroot user to administer Docker......Page 343
 Setting up the Docker host with Docker Machine......Page 344
 Finding help with the Docker command line......Page 347
Chapter 2: Working with Docker Containers......Page 348
 Listing/searching for an image......Page 349
 Pulling an image......Page 351
 Listing images......Page 353
 Starting a container......Page 354
 Listing containers......Page 357
 Looking at the logs of containers......Page 358
 Stopping a container......Page 359
 Deleting a container......Page 360
 Setting the restart policy on a container......Page 362
 Getting privileged access inside a container......Page 363
 Exposing a port while starting a container......Page 364
 Accessing the host device inside the container......Page 365
 Injecting a new process to a running container......Page 366
 Returning low-level information about a container......Page 367
 Labeling and filtering containers......Page 369
Chapter 3: Working with Docker Images......Page 372
 Introduction......Page 373
 Creating an account with Docker Hub......Page 374
 Creating an image from the container......Page 375
 Publishing an image to the registry......Page 377
 Looking at the history of an image......Page 379
 Deleting an image......Page 380
 Exporting an image......Page 382
 Building images using Dockerfiles......Page 383
 Building an Apache image – a Dockerfile example......Page 389
 Accessing Firefox from a container – a Dockerfile example......Page 392
 Building a WordPress image – a Dockerfile example......Page 396
 Setting up a private index/registry......Page 401
 Automated builds – with GitHub and Bitbucket......Page 405
 Creating the base image – using supermin......Page 408
 Creating the base image – using Debootstrap......Page 410
 Visualizing dependencies between layers......Page 411
 Introduction......Page 412
 Accessing containers from outside......Page 417
 Managing data in containers......Page 419
 Linking two or more containers......Page 423
 Developing a LAMP application by linking containers......Page 425
 Networking of multihost containers with Flannel......Page 427
 Assigning IPv6 addresses to containers......Page 432
 Introduction......Page 436
 Testing with Docker......Page 437
 Doing CI/CD with Shippable and Red Hat OpenShift......Page 440
 Doing CI/CD with Drone......Page 446
 Setting up PaaS with OpenShift Origin......Page 449
 Building and deploying an app on OpenShift v3 from the source code......Page 453
 Configuring Docker as a hypervisor driver for OpenStack......Page 457
 Introduction......Page 462
 Configuring the Docker daemon remote API......Page 463
 Performing image operations using remote APIs......Page 465
 Performing container operations using remote APIs......Page 468
 Exploring Docker remote API client libraries......Page 470
 Securing the Docker daemon remote API......Page 471
 Introduction......Page 476
 Benchmarking CPU performance......Page 480
 Benchmarking disk performance......Page 482
 Benchmarking network performance......Page 484
 Getting container resource usage using the stats feature......Page 486
 Setting up performance monitoring......Page 487
 Introduction......Page 490
 Running applications with Docker Compose......Page 492
 Setting up cluster with Docker Swarm......Page 494
 Setting up CoreOS for Docker orchestration......Page 496
 Setting up a Project Atomic host......Page 501
 Doing atomic update/rollback with Project Atomic......Page 506
 Adding more storage for Docker in Project Atomic......Page 507
 Setting up Cockpit for Project Atomic......Page 511
 Setting up a Kubernetes cluster......Page 514
 Scaling up and down in a Kubernetes cluster......Page 517
 Setting up WordPress with a Kubernetes cluster......Page 519
 Introduction......Page 526
 Setting Mandatory Access Control (MAC) with SELinux......Page 529
 Allowing writes to volume mounted from the host with SELinux ON......Page 532
 Removing capabilities to breakdown the power of a root user inside a container......Page 533
 Sharing namespaces between the host and the container......Page 535
 Introduction......Page 538
 Starting Docker in debug mode......Page 539
 Building a Docker binary from the source......Page 540
 Building your own bridge for container communication......Page 541
 Selecting the logging driver for containers......Page 543
 Getting real-time Docker events for containers......Page 544
Module 3: Kubernetes Cookbook......Page 548
 Exploring architecture......Page 550
 Preparing your environment......Page 557
 Building datastore......Page 562
 Creating an overlay network......Page 571
 Configuring master......Page 582
 Configuring nodes......Page 590
 Run your first container in Kubernetes......Page 598
 Introduction......Page 606
 An overview of Kubernetes control......Page 607
 Working with pods......Page 610
 Working with a replication controller......Page 616
 Working with services......Page 625
 Working with volumes......Page 636
 Working with secrets......Page 653
 Working with names......Page 658
 Working with namespaces......Page 663
 Working with labels and selectors......Page 670
 Scaling your containers......Page 678
 Updating live containers......Page 682
 Forwarding container ports......Page 689
 Ensuring flexible usage of your containers......Page 703
 Working with configuration files......Page 713
 Clustering etcd......Page 722
 Building multiple masters......Page 730
 Moving monolithic to microservices......Page 742
 Integrating with Jenkins......Page 756
 Working with the private Docker registry......Page 765
 Setting up the Continuous Delivery pipeline......Page 771
 Introduction......Page 784
 Building the Kubernetes infrastructure in AWS......Page 785
 Managing applications using AWS OpsWorks......Page 794
 Auto-deploying Kubernetes through Chef recipes......Page 802
 Using AWS CloudFormation for fast provisioning......Page 818
 Introduction......Page 840
 Advanced settings in kubeconfig......Page 841
 Setting resource in nodes......Page 847
 Playing with WebUI......Page 853
 Working with a RESTful API......Page 857
 Authentication and authorization......Page 862
 Collecting application logs......Page 870
 Working with Kubernetes logs......Page 881
 Working with etcd log......Page 885
 Monitoring master and node......Page 889
Bibliography......Page 902
Index......Page 904