A Developer's Guide to Amazon SimpleDB

Contents......Page 7
Preface......Page 16
Acknowledgments......Page 18
What SimpleDB Is Not......Page 19
Stored Securely in the Cloud......Page 20
Multi-Valued Attributes......Page 21
High Availability......Page 22
Database Consistency......Page 23
Benefits of Using SimpleDB......Page 24
Higher-Level Framework Functionality......Page 25
Abandoning the Relational Model?......Page 26
A Database Without a Schema......Page 27
Areas Where Relational Databases Struggle......Page 28
Avoiding the SimpleDB Hype......Page 29
Putting the DBA Out of Work......Page 30
Dodging Copies of C.J. Date......Page 31
Storing Large Objects with Amazon S3......Page 32
Windows Azure Platform......Page 33
Apache CouchDB......Page 35
Web Services for Connected Systems......Page 36
Dynamic Data Application......Page 37
Existing AWS Customers......Page 38
Summary......Page 39
Creating an AWS Account......Page 41
Finding a Client for SimpleDB......Page 42
Key Storage......Page 43
Implementing the Base Application......Page 44
Adding Domain Creation......Page 46
Listing Domain Metadata......Page 47
Building a User Authentication Service......Page 49
Representing User Data......Page 50
Fetching User Data with SimpleDBUserService......Page 52
Salting and Encoding Passwords......Page 54
Creating a User Update Tool......Page 55
Summary......Page 57
Selecting a SimpleDB Client......Page 59
Typica Setup in Java......Page 60
C# Library for Amazon SimpleDB Setup......Page 61
SimpleDB Endpoints......Page 63
Common Response Elements......Page 65
CreateDomain......Page 66
CreateDomain Snippet in Java......Page 67
CreateDomain Snippet in PHP......Page 68
ListDomains Response Data......Page 69
ListDomains Snippet in C#......Page 70
ListDomains Snippet in PHP......Page 71
DeleteDomain Response Data......Page 72
DeleteDomain Snippet in PHP......Page 73
DomainMetadata Response Data......Page 74
DomainMetadata Snippet in Java......Page 75
DomainMetadata Snippet in PHP......Page 76
PutAttributes......Page 77
PutAttributes Parameters......Page 78
PutAttributes Response Data......Page 80
PutAttributes Snippet in Java......Page 81
PutAttributes Snippet in C#......Page 82
GetAttributes Parameters......Page 83
GetAttributes Response Data......Page 84
GetAttributes Snippet in Java......Page 85
GetAttributes Snippet in C#......Page 86
GetAttributes Snippet in PHP......Page 87
DeleteAttributes Parameters......Page 88
DeleteAttributes Response Data......Page 89
DeleteAttributes Snippet in C#......Page 90
BatchPutAttributes......Page 91
BatchPutAttributes Parameters......Page 92
BatchPutAttributes Response Data......Page 93
BatchPutAttributes Snippet in Java......Page 94
BatchPutAttributes Snippet in C#......Page 95
BatchPutAttributes Snippet in PHP......Page 96
Select Parameters......Page 97
Select Response Data......Page 98
Select Snippet in Java......Page 99
Select Snippet in C#......Page 101
Select Snippet in PHP......Page 103
Summary......Page 104
Select Syntax......Page 105
Select Quoting Rule for Names......Page 106
Output Selection Clause......Page 107
Select Quoting Rules for Values......Page 108
Sort Clause......Page 109
LIMIT Clause......Page 110
Formatting Attribute Data for Select......Page 111
Integer Formatting......Page 112
Date and Time Formatting......Page 113
Expressions and Predicates......Page 115
Range Operators......Page 116
Prefix Queries with LIKE and NOT LIKE......Page 117
Multi-Valued Attribute Queries......Page 118
Multiple Predicate Queries with the INTERSECTION Operator......Page 119
Query Results with the Same Item Multiple Times......Page 120
Attribute Indexes......Page 121
Composite Attributes......Page 122
Judicious Use of LIKE......Page 123
Skipping Pages with count() and LIMIT......Page 124
Measuring Select Performance......Page 125
Automating Performance Measurements......Page 127
Summary......Page 128
5 Bulk Data Operations......Page 129
Mapping the Import File to SimpleDB Attributes......Page 130
Reporting Import Progress......Page 131
Managing Concurrency......Page 132
Verifying Progress and Completion......Page 133
Backup and Data Export......Page 134
Using Third-Party Backup Services......Page 135
Writing Your Own Backup Tool......Page 136
Summary......Page 137
Availability: The Final Frontier......Page 139
Item-Level Atomicity......Page 141
Looking into the Eventual Consistency Window......Page 142
Implementing a Consistent View......Page 143
Storing Text in S3......Page 146
Storing Overflow in Different Attributes......Page 147
Storing Overflow as a Multi-Valued Attribute......Page 148
Paging to Arbitrary Query Depth......Page 149
Exact Counting Without Locks or Transactions......Page 151
Using One Item Per Count......Page 152
Storing the Count in a Multi-Valued Attribute......Page 154
Designing for Testability......Page 156
Summary......Page 157
Estimating Initial Costs......Page 159
Keeping Tabs on SimpleDB Usage with AWS Usage Reports......Page 160
Creating More Finely Detailed Usage Reports......Page 163
Storage Requirements......Page 164
Understanding the Cost of Slack Space......Page 165
Scalability: Increasing the Load......Page 166
Using Read-Repair to Apply Formatting Changes......Page 168
Using a Batch Process to Apply Updates......Page 170
Summary......Page 171
Managing Access Within the Organization......Page 173
Limiting Amazon Access from AWS Credentials......Page 175
Boosting Security with Multi-Factor Authentication......Page 176
Key Management......Page 177
Secret Key Rotation......Page 178
Storing Clean Data......Page 179
SSL and Data in Transmission......Page 180
Data Storage and Encryption......Page 182
Summary......Page 183
Targeting Moderate Performance in Small Projects......Page 185
Exploiting Advanced Features in Small Projects......Page 186
Accessing SimpleDB from EC2......Page 187
Caching......Page 188
Concurrency......Page 190
Keeping Requests and Responses Small......Page 191
Optimizing GetAttributes......Page 192
Optimizing PutAttributes......Page 196
Optimizing BatchPutAttributes......Page 197
Optimizing Select......Page 198
Multiplexing Queries......Page 199
Working Around Latency......Page 200
Summary......Page 201
Client Design Overview......Page 203
Public Interface......Page 204
Attribute Class......Page 206
Item Class......Page 208
High-Level Design Issues......Page 209
Operation-Specific Considerations......Page 211
Safe Handling of the Secret Key......Page 214
Implementing the Constructor......Page 215
Implementing the Remaining Methods......Page 216
Making Requests......Page 218
Computing the Signature......Page 226
Making the Connections......Page 228
Parsing the Response......Page 232
Summary......Page 234
Convenient Count Methods......Page 235
Custom Metadata and Building a Smarter Client......Page 237
Justifying a Schema for Numeric Data......Page 238
Storing Custom Metadata within SimpleDB......Page 239
Automatically Optimizing for Box Usage Cost......Page 240
The Exponential Cost of Write Operations......Page 241
QueryTimeout: The Most Expensive Way to Get Nothing......Page 243
Put/Get Delete Routing......Page 246
Query Multiplexing......Page 249
Summary......Page 250
Requirements......Page 251
The Data Model......Page 252
Implementing User Authentication......Page 253
Implementing a Task Workspace......Page 256
Implementing a Task Service......Page 259
Adding the Login Servlet......Page 262
Displaying the Tasks......Page 267
Deployment......Page 270
Summary......Page 272
A......Page 273
B......Page 274
C......Page 275
D......Page 277
G......Page 278
J......Page 279
M......Page 280
P......Page 281
Q......Page 282
R......Page 283
S......Page 284
U......Page 286
X......Page 287