Hands-On Enterprise Automation with Python: Automate common administrative and security tasks with Python

Title Page......Page 2
Copyright and Credits......Page 3
Hands-On Enterprise Automation with Python......Page 4
Packt Upsell......Page 5
Why subscribe?......Page 6
PacktPub.com......Page 7
Contributors......Page 8
About the author......Page 9
About the reviewer......Page 10
Packt is searching for authors like you......Page 11
Preface......Page 32
Who this book is for......Page 33
What this book covers......Page 34
To get the most out of this book......Page 37
Download the example code files......Page 38
Download the color images......Page 39
Conventions used......Page 40
Get in touch......Page 41
Reviews......Page 42
Setting Up Our Python Environment......Page 43
An introduction to Python......Page 44
Python versions......Page 45
Why are there two active versions?......Page 46
Should you only learn Python 3?......Page 47
Does this mean I can't write code that runs on both Python 2 and Python 3?......Page 48
Python installation......Page 50
Installing the PyCharm IDE......Page 55
Setting up a Python project inside PyCharm......Page 58
Exploring some nifty PyCharm features......Page 63
Code debugging......Page 64
Code refactoring......Page 67
Installing packages from the GUI......Page 69
Summary......Page 72
Common Libraries Used in Automation......Page 73
Understanding Python packages......Page 74
Package search paths......Page 75
Common Python libraries......Page 77
Network Python Libraries......Page 78
System and cloud Python libraries......Page 82
Accessing module source code......Page 85
Visualizing Python code......Page 88
Summary......Page 94
Setting Up the Network Lab Environment......Page 95
Technical requirements......Page 96
When and why to automate the network......Page 97
Why do we need automation?......Page 98
Screen scraping versus API automation......Page 99
Why use Python for network automation?......Page 100
The future of network automation......Page 103
Network lab setup......Page 104
Getting ready – installing EVE-NG......Page 105
Installation on VMware Workstation......Page 106
Installation over VMware ESXi......Page 108
Installation over Red Hat KVM......Page 110
Accessing EVE-NG......Page 112
Installing EVE-NG client pack......Page 116
Loading network images into EVE-NG......Page 118
Building an enterprise network topology......Page 119
Adding new nodes......Page 120
Connecting nodes together......Page 122
Summary......Page 124
Using Python to Manage Network Devices......Page 125
Technical requirements......Page 126
Python and SSH......Page 127
Paramiko module......Page 128
Module installation......Page 129
SSH to the network device......Page 130
Netmiko module......Page 132
Vendor support......Page 133
Installation and verification......Page 135
Using netmiko for SSH......Page 136
Configuring devices using netmiko......Page 138
Exception handling in netmiko......Page 139
Device auto detect......Page 141
Using the telnet protocol in Python......Page 143
Push configuration using telnetlib......Page 146
Handling IP addresses and networks with netaddr......Page 148
Netaddr installation......Page 150
Exploring netaddr methods......Page 151
Sample use cases......Page 154
Backup device configuration......Page 155
Building the python script......Page 156
Creating your own access terminal......Page 159
Reading data from an Excel sheet......Page 162
More use cases......Page 165
Summary......Page 166
Extracting Useful Data from Network Devices......Page 167
Technical requirements......Page 168
Understanding parsers......Page 169
Introduction to regular expressions......Page 170
Creating a regular expression in Python......Page 172
Configuration auditing using CiscoConfParse......Page 179
CiscoConfParse library......Page 180
Supported vendors......Page 181
CiscoConfParse installation......Page 182
Working with CiscoConfParse......Page 183
Visualizing returned data with matplotLib......Page 187
Matplotlib installation......Page 188
Hands-on with matplotlib......Page 189
Visualizing SNMP using matplotlib......Page 192
Summary......Page 194
Configuration Generator with Python and Jinja2......Page 195
What is YAML?......Page 196
YAML file formatting......Page 197
Text editor tips......Page 201
Building a golden configuration with Jinja2......Page 202
Reading templates from the filesystem......Page 210
Using Jinja2 loops and conditions......Page 212
Summary......Page 220
Parallel Execution of Python Script......Page 221
How a computer executes your Python script......Page 222
Python multiprocessing library......Page 225
Getting started with multiprocessing......Page 226
Intercommunication between processes......Page 230
Summary......Page 232
Preparing a Lab Environment......Page 233
Getting the Linux operating system......Page 234
Downloading CentOS......Page 235
Downloading Ubuntu......Page 236
Creating an automation machine on a hypervisor......Page 238
Creating a Linux machine over VMware ESXi......Page 239
Creating a Linux machine over KVM......Page 245
Getting started with Cobbler......Page 249
Understanding how Cobbler works......Page 250
Installing Cobbler on an automation server......Page 252
Provisioning servers through Cobbler......Page 256
Summary......Page 261
Using the Subprocess Module......Page 262
The popen() subprocess......Page 263
Reading stdin, stdout, and stderr......Page 266
The subprocess call suite......Page 269
Summary......Page 270
Running System Administration Tasks with Fabric......Page 271
Technical requirements......Page 272
What is Fabric?......Page 273
Installation......Page 274
Fabric operations......Page 276
Using run operation......Page 277
Using get operation......Page 278
Using put operation......Page 279
Using sudo operation......Page 280
Using prompt operation......Page 281
Using reboot operation......Page 282
Executing your first Fabric file......Page 283
More about the fab tool......Page 287
Discover system health using Fabric......Page 289
Other useful features in Fabric......Page 294
Fabric roles......Page 295
Fabric context managers......Page 297
Summary......Page 299
Generating System Reports and System Monitoring......Page 300
Collecting data from Linux......Page 301
Sending generated data through email......Page 306
Using the time and date modules......Page 310
Running the script on a regular basis......Page 312
Managing users in Ansible......Page 314
Linux systems......Page 315
Microsoft Windows......Page 317
Summary......Page 318
Interacting with the Database......Page 319
Installing MySQL on an automation server......Page 320
Securing the installation......Page 322
Verifying the database installation......Page 324
Accessing the MySQL database from Python......Page 325
Querying the database......Page 327
Inserting records into the database......Page 329
Summary......Page 332
Ansible for System Administration......Page 333
Ansible terminology......Page 334
Installing Ansible on Linux......Page 336
On RHEL and CentOS......Page 337
Ubuntu......Page 338
Using Ansible in ad hoc mode......Page 339
How Ansible actually works......Page 343
Creating your first playbook......Page 344
Understanding Ansible conditions, handlers, and loops......Page 347
Designing conditions......Page 348
Creating loops in ansible......Page 351
Trigger tasks with handlers......Page 353
Working with Ansible facts......Page 355
Working with the Ansible template......Page 357
Summary......Page 359
Creating and Managing VMware Virtual Machines......Page 360
Setting up the environment......Page 361
Generating a VMX file using Jinja2......Page 365
Building the VMX template......Page 366
Handling Microsoft Excel data......Page 371
Generating VMX files......Page 374
VMware Python clients......Page 381
Installing PyVmomi......Page 383
First steps with pyvmomi......Page 384
Changing the virtual machine state......Page 389
There's more......Page 391
Using Ansible playbook to manage instances......Page 392
Summary......Page 396
Interacting with the OpenStack API......Page 397
Understanding RESTful web services......Page 399
Setting up the environment......Page 401
Installing rdo-OpenStack package......Page 402
On RHEL 7.4......Page 403
On CentOS 7.4......Page 404
Generating answer file......Page 405
Editing answer file......Page 406
Run the packstack......Page 407
Access the OpenStack GUI......Page 408
Sending requests to the OpenStack keystone......Page 409
Creating instances from Python......Page 413
Creating the image......Page 414
Assigning a flavor......Page 418
Creating the network and subnet......Page 420
Launching the instance......Page 423
Managing OpenStack instances from Ansible......Page 425
Shade and Ansible installation......Page 426
Building the Ansible playbook......Page 427
Running the playbook......Page 430
Summary......Page 432
Automating AWS with Boto3......Page 433
AWS Python modules......Page 434
Boto3 installation......Page 435
Managing AWS instances......Page 437
Instance termination......Page 439
Automating AWS S3 services......Page 440
Creating buckets......Page 441
Uploading a file to a bucket......Page 442
Deleting a bucket......Page 443
Summary......Page 444
Using the Scapy Framework......Page 445
Understanding Scapy......Page 446
Installing Scapy......Page 447
Unix-based systems......Page 448
Installing in Debian and Ubuntu......Page 449
Installing in Red Hat/CentOS......Page 450
Windows and macOS X Support......Page 451
Generating packets and network streams using Scapy......Page 452
Capturing and replaying packets......Page 459
Injecting data inside packets......Page 462
Packet sniffing......Page 465
Writing the packets to pcap......Page 467
Summary......Page 468
Building a Network Scanner Using Python......Page 469
Understanding the network scanner......Page 470
Building a network scanner with Python......Page 471
Enhancing the code......Page 473
Scanning the services......Page 476
Sharing your code on GitHub......Page 480
Creating an account on GitHub......Page 481
Creating and pushing your code......Page 482
Summary......Page 489
Other Books You May Enjoy......Page 490
Leave a review - let other readers know what you think......Page 492