Mastering Snowflake Solutions: Supporting Analytics and Data Sharing

Table of Contents
About the Author
About the Technical Reviewer
Acknowledgments
Introduction
Chapter 1: Snowflake Architecture
	Technology and Data Are Inseparable
		Unlocking Business Value
		Business Agility Is More Important Than Ever
		All Hail the Cloud!
	Decisions, Decisions, Decisions!
	Snowflake Architecture
	Database Storage
	Micro Partitions
	What Is the Benefit of Micro Partitioning?
	Partitioning in the Pre-Snowflake World
	Data Clustering
	Virtual Warehouses
	Caching
		Result Cache
		Local Disk Cache
	Configuring Virtual Warehouses
		Number of Clusters
		Scaling Policy
		Auto Suspend
	Query Processing
	Cloud Services
		Authentication
		Infrastructure Management
		Metadata Management
		Query Parsing and Execution
		Access Control
	Summary
Chapter 2: Data Movement
	Stages
		External Stages
		External Tables and Data Lakes
		Internal Stages
			User
			Table
			Named
	File Formats
	The COPY INTO Command
		COPY INTO Syntax
		Transformations
	Data Loading Considerations
		File Preparation
		Semistructured Data
		Dedicated Virtual Warehouses
		Partitioning Staged Data
		Loading Data
		Loading Using the Web UI
	Unloading Data from Snowflake
	Bulk vs. Continuous Loading
	Continuous Data Loads Using Snowpipe
	Streams and Tasks
		Change Tracking Using Streams
		Stream Metadata Columns
		Tasks
	Bringing It All Together
		The Example Scenario
		Steps
	Summary
Chapter 3: Cloning
	A Word on Performance Testing
	Testing with Data
	Forget the Past!
	Sensitive Data
	Why Clone an Object?
	Working with Clones
		Which Objects Can Be Cloned?
		Clone Permissions
	Bringing It All Together
		The Example Scenario
		Steps
	Summary
Chapter 4: Managing Security and Access Control
	Roles
		Role Hierarchy
		Inheritance
	Objects
	Extending the Role Hierarchy
	User and Application Authentication
		Multi-Factor Authentication
		MFA Caching
		Security Assertion Markup Language
		OAuth
		Key Pair Authentication
	Storage Integration
	Network Policies
		Option 1: Native Network Security
		Option 2: Network Policies
		Option 3: Cloud Service Provider Capabilities
	Handling PII Data
		Separately Storing PII Data
		Removing Data in Bulk
		Auditing
		Controlling Access to PII Data
	Row Access Policies
		Example Scenario
		Steps
	Advanced Snowflake Security Features
		Future Grants
		Managed Access Schemas
	Summary
Chapter 5: Protecting Data in Snowflake
	Data Encryption
		Encryption Key Management
		Customer Managed Keys
	Time Travel
		Data Retention Periods
		Querying Historical Data
		Dropping and Undropping Historical Data
	Fail-safe
	Underlying Storage Concepts
		Temporary and Transient Tables
		Bringing It All Together
	Summary
Chapter 6: Business Continuity and Disaster Recovery
	Regions and Availability Zones
	Data Replication, Failover, and Failback
		Primary and Secondary Databases
		Promoting Databases
		Client Redirect
	Business Continuity
		Process Flow
		Monitoring Replication Progress
		Reconciling the Process
		Data Loss
	Bringing It All Together
		The Example Scenario
		Steps
			Step 1: Configure Replication and Failover
			Step 2: Select an Account to Replicate the Data to
			Step 3: Create a Secondary Database on the Replicated Account
			Step 4: Monitor the Initial Data Refresh
			Step 5: Schedule Ongoing Data Refreshes
	Summary
Chapter 7: Data Sharing and the Data Cloud
	The Data Cloud
	Data Sharing
		The Data Marketplace
			Monetization
			Data Exchange
		Providers and Consumers
		What Is a Share?
		Reader Accounts
		Using a Dedicated Database for Data Sharing
	Data Clean Rooms
	Bringing It All Together
		The Example Scenario
	Summary
Chapter 8: Programming
	Creating New Tables
		Create Table Like
		Create Table as Select
		Create Table Clone
		Copy Grants
	Stored Procedures
	User-Defined Functions
		Scalar Functions
		Table Functions
	SQL Variables
	Transactions
		Transactions Within Stored Procedures
		Locking and Deadlocks
		Transaction Tips
	Bringing It All Together
		The Example Scenario
		Steps
	Summary
Chapter 9: Advanced Performance Tuning
	Designing Tables for High Performance
		Data Clustering
			Clustering Key
			Pruning Efficiency
			Clustering Depth
			Reclustering
	Designing High-Performance Queries
		Optimizing Queries
			Cardinality
		Materialized Views
		Search Optimization Service
	Optimizing Warehouse Utilization
		Warehouse Utilization Patterns
		Leveraging Caching
	Monitoring Resources and Account Usage
		Resource Monitors
		Query History
		Useful References
	Summary
Chapter 10: Developing Applications in Snowflake
	Introduction to SnowSQL
		Versions and Updates
		Config File
		Authentication
		Using SnowSQL
	Data Engineering
		Java User-Defined Functions
		Snowpark
			Data Frames
		Combining Snowpark and UDFs
	Connectors
		Snowflake Connector for Python
		Querying Data
			Asynchronous and Synchronous Queries
			The Query ID
		Snowflake Connector for Kafka
		A Solution Architecture Example
	Summary
Index