Visualizing data

Visualizing Data......Page 1
Table of Contents......Page 4
Preface......Page 8
The Audience for This Book......Page 9
Overview of the Book......Page 10
Acknowledgments......Page 11
Conventions Used in This Book......Page 12
We’d Like to Hear from You......Page 13
The Seven Stages of Visualizing Data......Page 16
Data Collection......Page 17
What Is the Question?......Page 18
Process......Page 20
An Example......Page 21
Acquire......Page 22
Parse......Page 23
Represent......Page 24
Interact......Page 26
Iteration and Combination......Page 29
Principles......Page 30
Each Project Has Unique Requirements......Page 31
Know Your Audience......Page 32
Onward......Page 33
Getting Started with Processing......Page 34
Hello World......Page 35
Hello Mouse......Page 36
Saving Your Work......Page 38
More About the size() Method......Page 39
Loading and Displaying Data......Page 41
Libraries Add New Features......Page 42
Sketching and Scripting......Page 43
Don’t Start by Trying to Build a Cathedral......Page 44
Ready?......Page 45
Drawing a Map......Page 46
Locations on a Map......Page 47
Data on a Map......Page 49
Two-Sided Data Ranges......Page 55
Provide More Information with a Mouse Rollover (Interact)......Page 57
Updating Values over Time (Acquire, Mine)......Page 61
Smooth Interpolation of Values over Time (Refine)......Page 63
Using Your Own Data......Page 66
Taking Data from the User......Page 67
Next Steps......Page 68
Time Series......Page 69
Cleaning the Table (Filter and Mine)......Page 70
A Simple Plot (Represent and Refine)......Page 72
Labeling the Current Data Set (Refine and Interact)......Page 74
Drawing Axis Labels (Refine)......Page 77
Year Labels......Page 78
Labeling Volume on the Vertical Axis......Page 80
Bringing It All Together and Titling Both Axes......Page 84
Choosing a Proper Representation (Represent and Refine)......Page 88
Using Rollovers to Highlight Points (Interact)......Page 91
Ways to Connect Points (Refine)......Page 92
Showing Data As an Area......Page 93
Further Refinements and Erasing Elements......Page 95
Discrete Values with a Bar Chart (Represent)......Page 97
Adding the Necessary Variables......Page 98
Drawing Tabs Instead of a Single Title......Page 99
Better Tab Images (Refine)......Page 100
Interpolation Between Data Sets (Interact)......Page 102
End of the Series......Page 107
Changing Data Sources......Page 109
Problem Statement......Page 110
Retrieving Win/Loss Data (Acquire)......Page 111
Data source for baseball statistics......Page 112
Unpacking the Win/Loss files (Mine and Filter)......Page 115
Introducing regular expressions......Page 117
Retrieving Team Logos (Acquire, Refine)......Page 122
Retrieving Salary Data (Acquire, Parse, Filter)......Page 124
Using the Preprocessed Data (Acquire, Parse, Filter, Mine)......Page 126
Team Names and Codes......Page 127
Team Salaries......Page 128
Win-Loss Standings......Page 130
Finishing the Setup......Page 132
Displaying the Results (Represent)......Page 133
Highlighting the Lines......Page 136
A Better Typeface for Numeric Data......Page 138
Sophisticated Sorting: Using Salary As a Tiebreaker (Mine)......Page 141
Moving to Multiple Days (Interact)......Page 142
Load Standings for the Entire Season......Page 145
Switching Between Dates......Page 146
Smoothing Out the Interaction (Refine)......Page 147
Deployment Considerations (Acquire, Parse, Filter)......Page 148
Data from the U.S. Census Bureau (Acquire)......Page 160
Dealing with the Zip Code Database File (Parse and Filter)......Page 162
Building the Preprocessor......Page 166
What about a binary data file or a database?......Page 169
Loading the Data (Acquire and Parse)......Page 170
Drawing a Scatterplot of Zip Codes (Mine and Represent)......Page 172
Highlighting Points While Typing (Refine and Interact)......Page 173
Show the Currently Selected Point (Refine)......Page 177
Progressively Dimming and Brightening Points (Refine)......Page 180
Zooming In (Interact)......Page 182
Changing How Points Are Drawn When Zooming (Refine)......Page 192
Deployment Issues (Acquire and Refine)......Page 193
Next Steps......Page 195
Using Recursion to Build a Directory Tree......Page 197
Caveats When Dealing with Files (Filter)......Page 198
Recursively Printing Tree Contents (Represent)......Page 199
Using a Queue to Load Asynchronously (Interact)......Page 201
Showing Progress (Represent)......Page 203
An Introduction to Treemaps......Page 204
A Simple Treemap Example......Page 205
Reading the Directory Structure (Acquire, Parse, Filter, Mine, Represent)......Page 209
Viewing Folder Contents (Interact)......Page 214
Improving the Treemap Display (Refine)......Page 216
Maintaining Context (Refine)......Page 219
Making Colors More Useful (Mine, Refine)......Page 221
Flying Through Files (Interact)......Page 223
Updating FileItem for zoom......Page 225
Updating FolderItem......Page 228
Adding a Folder Selection Dialog (Interact)......Page 232
Next Steps......Page 234
Simple Graph Demo......Page 235
Porting from Java to Processing......Page 236
Interacting with Nodes......Page 239
Reading a Book (Parse)......Page 244
Removing Stop Words (Filter)......Page 246
Smarter Addition of Nodes and Edges (Mine)......Page 247
Viewing the Book (Represent and Refine)......Page 248
Saving an Image in a Vector Format......Page 251
Checking Our Work......Page 253
Approaching Network Problems......Page 255
Advanced Graph Example......Page 257
Step-by-step instructions if you’re new to Eclipse......Page 258
Reading Apache Logfiles (Parse)......Page 260
A Look at the Other Source Files......Page 263
Moving from Processing to Java......Page 264
Helpful additions in Java 1.5 (J2SE 5.0) and later......Page 265
Reading and Cleaning the Data (Acquire, Parse, Filter)......Page 267
Filtering site addresses and aliases......Page 268
Filtering for useful page information......Page 269
Bringing It All Together (Mine and Represent)......Page 270
Depicting Branches and Nodes (Represent and Refine)......Page 271
Playing with Data (Interact)......Page 273
Drawing Node Names (Represent and Refine)......Page 274
Drawing Visitor Paths (Represent and Refine)......Page 275
Mining Additional Information......Page 277
Acquiring Data......Page 279
Where to Find Data......Page 280
Tools for Acquiring Data from the Internet......Page 281
NcFTP and Links......Page 282
Uniform Resource Locator (URL)......Page 283
Specifying Output Locations......Page 284
Files Too Large for loadStrings()......Page 285
Reading Files Progressively......Page 287
Reading Files Asynchronously with a Thread......Page 288
Dealing with Files and Folders......Page 291
Listing Files in a Folder......Page 292
Listing files with a filter class......Page 294
Handling Numbered File Sequences......Page 295
Asynchronous Image Downloads......Page 296
Handling Web Forms......Page 299
Pretending to Be a Web Browser......Page 301
Using a Database......Page 303
Getting Started with MySQL......Page 304
Using MySQL with Processing......Page 306
Other Database Options......Page 308
Performance Aspects of Databases in Interactive Applications......Page 309
Dealing with a Large Number of Files......Page 310
Levels of Effort......Page 311
Tools for Gathering Clues......Page 313
Comma-Separated Values (CSV)......Page 314
Text with Fixed Column Widths......Page 317
HyperText Markup Language (HTML)......Page 318
Embedding Tidy into a sketch......Page 320
Is a parser necessary?......Page 321
Using Swing’s built-in HTML parser......Page 323
Parsing and manipulating tables from HTML files......Page 325
Cleaning up XML......Page 326
Example: Using the Processing XML library to read geocoding data......Page 327
Other methods for parsing XML......Page 329
JavaScript Object Notation (JSON)......Page 330
Grammars and BNF Notation......Page 331
PKZip files (ZIP)......Page 332
Other compression formats......Page 334
Scalable Vector Graphics (SVG)......Page 335
OBJ and AutoCAD DXF......Page 337
PostScript (PS) and Portable Document Format (PDF)......Page 338
Shapefile and Well-Known Text......Page 339
dBASE/xBase (DBF)......Page 340
Bit Shifting......Page 341
DataInputStream......Page 342
Watching Network Traffic......Page 343
Programming Modes......Page 346
Continuous......Page 347
Java......Page 348
Additional Source Files (Tabs)......Page 349
The Preprocessor......Page 350
Event Handling......Page 351
The main() Method......Page 352
Two Models for Updating the Screen......Page 353
Embedding in a Swing Application......Page 355
Packaging Code into Libraries......Page 357
Building with the Source for processing.core......Page 358
Filter and Mine......Page 360
Refine......Page 361
General......Page 362
Index......Page 364