Big Data Analytics Strategies for the Smart Grid

THE TRANSFORMATIVE POWER OF DATA ANALYTICS

Putting the Smarts in the Smart Grid
Chapter Goal
The Imperative for the Data-Driven Utility
Big Data: We’ll Know It When We See It
What Are Data Analytics?
     The Data Analytics Infrastructure
Starting from Scratch 
     Mind the Gap 
     Culture Shift
     A Personal Case Study 
     Ouija Board Economics 
     Business as Usual Is Fatal to the Utility 
     To Be or Not to Be
Finding Opportunity with Smart Grid Data Analytics

Building the Foundation for Data Analytics
Chapter Goal
Perseverance Is the Most Important Tool
     "It’s Too Hard" Is Not an Answer
Building the Analytical Architecture 
     The Art of Data Management 
     Managing Big Data Is a Big Problem 
     The Truth Won’t Set You Free 
     One Size Doesn’t Fit All 
     Solving the "Situation-Specific" Dilemma 
     The Build-Versus-Buy War Rages On 
      When the Cloud Makes Sense 
     Change Is Danger and Opportunity

Transforming Big Data for High-Value Action
Chapter Goal
The Utility as a Data Company 
     Creating Results with the Pareto Principle
Algorithms 
     The Business of Algorithms 
     Data Classes 
     Just in Time
Seeing Intelligence 
     Remember the Human Being
     The Problem with Customers 
     The Transformation of the Utility
     Bigger Is Not Always Better
Assessing the Business Issues 
     Start with a Framework

THE BENEFITS OF SMART GRID DATA ANALYTICS

Applying Analytical Models in the Utility
Chapter Goal
Understanding Analytical Models 
     What Exactly Are Models? 
     Warning: Correlation Still Does Not Imply Causation
Using Descriptive Models for Analytics
Using Diagnostic Models for Analytics 
     How Diagnostic Tools Help Utilities
Predictive Analytics
Prescriptive Analytics
An Optimization Model for the Utility
Toward Situational Intelligence

Enterprise Analytics
Chapter Goal
Moving Beyond Business Intelligence 
     Energy Forecasting 
     Asset Management 
     Demand Response and Energy Analytics 
     Dynamic-Pricing Analytics 
     Revenue-Protection Analytics
     Breaking Down Functional Barriers

Operational Analytics
Chapter Goal
Aligning the Forces for Improved Decision-Making
The Opportunity for Insight 
     Adaptive Models
Focus on Effectiveness 
     Visualizing the Grid 
     Distributed Generation Operations: Managing the Mix-Up
Grid Management
     The Relationship Between Standards and Analytics
Resiliency Analytics
Extracting Value from Operational Data Analytics

Customer Operations and Engagement Analytics
Chapter Goal
Increasing Customer Value 
     Customer Service 
     Advanced Customer Segmentation
     Sentiment Analysis 
     Revenue Collections
     Call Center Operations 
     Utility Communications
What’s in It for the Customer? 
     Enhanced Billing and Customer-Facing Web Portals 
     Home Energy Management 
     Strategic Value

Analytics for Cybersecurity
Chapter Goal
Cybersecurity in the Utility Industry
     The Threat Against Critical Infrastructure
     How the Smart Grid Increases Risk 
     The Smart Grid as Opportunity for Dark Mischief
The Role of Big Data Cybersecurity Analytics 
     Predict and Protect 
     Cybersecurity Applications 
     Proactive Approaches 
     Global Action for Coordinated Cybersecurity 
     The Changing Landscape of Risk

IMPLEMENTING DATA ANALYTICS PROGRAMS FOR SUSTAINED CHANGE

Sourcing Data
Chapter Goal
Sourcing the Data 
     Smart Meters 
     Sensors 
     Control Devices 
     Intelligent Electronic Devices 
     Distributed Energy Resources 
     Consumer Devices 
     Historical Data 
     Third-Party Data
Working with a Variety of Data Sources 
     Data Fusion

Big Data Integration, Frameworks, and Databases
Chapter Goal
This Is Going to Cost
Storage Modalities 
     Hyperscale 
     Network-Attached Storage
     Object Storage
Data Integration
The Costs of Low-Risk Approaches
Let the Data Flow 
     Hadoop 
     MapReduce 
     Hadoop Distributed File System 
     How Does This Help Utilities?
Other Big Data Databases 
     NoSQL 
     In-Memory or Main Memory Databases 
     Object-Oriented Database Management Systems
     Time Series Database Servers 
     Spatial and GIS Databases
The Curse of Abundance

Extracting Value
Chapter Goal
We Need Some Answers Here 
     How Long Does This Take?
Mining Data for Information and Knowledge
The Process of Data Extraction 
     When More Isn’t Always Better 
      Running for Performance 
     Hadoop: A Single-Purpose Batch-Data Platform?
Stream Processing 
     Complex Event Processing 
     Process Historians
Avoid Irrational Exuberance

Envisioning the Utility
Chapter Goal
Big Data Comprehension
Why Humans Need Visualization 
     Walking Toward the Edge
The Role of Human Perception
     Preattentive Processing
The Utility Visualized 
     Advancing Business Intelligence 
     High-Impact Operations 
     Improving Customer Value
Making Sense of It All

A Partnership for Change
Chapter Goal
With Big Data Comes Big Responsibility
     Abandon All Hope, Ye Who Enter Here?
Privacy, Not Promises 
     Consent
     Data Management
     Governance
Privacy Enhancement 
     Enabling Consent 
     Data Minimization
     The Role of Metadata
The Utility of the Future Is a Good Partner

Glossary