Software Vectorization Handbook, The: Applying Intel Multimedia Extensions for Maximum Performance

Preface 10
1. Introduction 12
 Architectural Acceleration Mechanisms 12
  Pipelining and Replication 13
  Speedup 14
 Quick Tour of Parallel Architectures 15
  Data Parallel Architectures 15
  Instruction-Level Parallel Architectures 17
  Process-Level Parallel Architectures 18
 Multimedia Extensions 19
  MMX™ Technology 20
  Streaming-SIMD Extensions 22
  Intra-Register Vectorization 24
2. Instruction Set Preliminaries 28
 Instruction Set Summary 28
  Instruction Format 29
  Packed Data Elements 29
  Data Movement Instructions 30
  Arithmetic Instructions 36
  Logical Instructions 39
  Comparison Instructions 40
  Conversion Instructions 41
  Shift Instructions 43
  Shuffle Instructions 44
  Unpack Instructions 45
  Cacheability Control and Prefetch Instructions 46
  State Management Instructions 47
 The Intel NetBurst® Microarchitecture 48
  Execution Logic 48
  Memory Hierarchy 50
3. Language Preliminaries 52
 The C Programming Language 52
  Data Types 53
  Expressions 55
  Statements 57
 Loop and Idiom Recognition 58
  Well-Behaved Loops 59
  Idiom Recognition 61
4. Data Dependence Theory 64
 Data Dependences 64
  Data Dependence Definitions 64
  Data Dependence Terminology 66
  Data Dependence Graphs 67
 Data Dependence Analysis 68
  Data Dependence Problems 68
  Data Dependence Solvers 70
  Hierarchical Data Dependence Analysis 72
 Improving Data Dependence Analysis 74
  Compiler Hints for Data Dependences 75
  Aliasing Analysis 75
  Dynamic Data Dependence Analysis 76
5. Vectorization Essentials 80
 Validity of Vectorization 80
  Preserving Data Dependences 81
  Preserving Integer Precision 84
  Preserving Floating-Point Precision 86
 Vector Code Generation 88
  General Framework 88
  Vector Data Type Selection 90
  Unit-Stride Memory References 91
  Rotating Read-Only Memory References 92
  Non-Unit-Stride Memory References 93
  Scalar Memory References 94
  Operators 108
  MIN, MAX, and ABS Operators 110
  Type Conversions 113
  Mathematical Functions 117
  Conditional Statements 121
6. Alignment Optimizations 130
 Intraprocedural Alignment Optimizations 131
  Memory Allocation and Data Layout 131
  Intraprocedural Alignment Analysis 132
  Cache Line Split Optimizations 134
 Interprocedural Alignment Optimizations 140
  Interprocedural Alignment Analysis 140
  Exploiting Interprocedural Alignment Information 145
 Improving Alignment Optimizations 146
  Compiler Hints for Alignment 146
  Multi-Version Code 146
  Dynamic Loop Peeling 149
7. Supplemental Optimizations 156
 Idiom Recognition 156
  Conversion Idioms 157
  Arithmetic Idioms 158
  Reduction Idioms 160
  Saturation Idioms 161
  Search Loops 171
 Complex Data 174
  Complex Numbers 174
  Single-Precision Complex Data Types 175
  Double-Precision Complex Data Types 179
 Memory Hierarchy Optimizations 180
  High-Level Optimizations 180
  Vector Register Reuse 182
  Low-Level Optimizations 185
8. Vectorization Beyond Loops 188
 Loop Materialization 189
  Rollable Statements and Expressions 189
  Loop Materialization and Collapsing 191
  Inexpensive Loop Materialization 192
  Improved Loop Materialization 194
 Performance Considerations 196
  Low Trip-Count Loops 196
  High Trip-Count Loops 199
9. Vectorization with the Intel Compilers 204
 Vectorization Overview 205
  Compiler Switches 205
  Profile-Guided Optimization 209
  Compiler Hints 210
 Vectorization Guidelines 214
  Design and Implementation Considerations 215
  Focus of Optimization 219
  Diagnostics-Guided Optimization 219
 Final Remarks 224
  Some More Experiments 224
  Future Trends in Multimedia Extensions 227
References 230
Index 242