No Code Required: Giving Users Tools to Transform the Web

Cover Page
......Page 1
Front matter
......Page 3
Copyright
......Page 4
Foreword
......Page 6
Overview of the book
......Page 8
Accessibility
......Page 9
About the Editors
......Page 11
Contributors
......Page 12
Introduction......Page 17
Five key insights......Page 18
Motivation for mashing up......Page 19
Experimental results......Page 345
Send text alerts......Page 20
Add nutritional information......Page 21
The gray areas......Page 23
The special case of spreadsheet programming......Page 26
The syntax of scripting languages......Page 27
Inferring intent......Page 28
Presenting programs to the user......Page 30
Open access to applications......Page 32
Semantic information......Page 34
Semantic information and HTML......Page 35
Acknowledgments......Page 37
Introduction......Page 38
Example: News on a map......Page 186
Related Work......Page 297
Examples of web customization......Page 41
Kind of Web site......Page 42
Kind of customization......Page 44
Support for adding conditions and loops......Page 232
One-shot vs. repeated use......Page 46
Template-based search......Page 254
Binding lenses......Page 47
Why we customize......Page 48
Recording and replaying Web interaction......Page 177
Customizing and Automating
......Page 51
Transforming a Web site's appearance......Page 53
Atomate walkthrough......Page 141
Region description study......Page 54
Pattern matching......Page 56
Clicking......Page 58
Inky feedback......Page 306
Navigation and page loading......Page 60
Web command-line algorithm......Page 61
Widgets......Page 62
Iteration......Page 328
Database integration......Page 356
Keyword matching algorithm......Page 64
Related work......Page 65
Automaton-based indexing......Page 67
Integrating a bookstore and a library......Page 68
Making a bug tracker more dynamic......Page 69
Adding faces to Webmail......Page 71
Discussion......Page 73
Method......Page 74
Acknowledgments......Page 76
Chickenfoot......Page 77
Contributions......Page 78
The highlight system......Page 122
Open Mind......Page 79
Scenario: Extending the system......Page 145
Related work......Page 146
Atomate......Page 80
Typed dataflow and editing......Page 230
Creo......Page 82
Inky commands......Page 84
Summary......Page 408
Back to the future......Page 86
Leveraging commonsense knowledge to understand the context of text......Page 87
Dealing with the ambiguity of natural language......Page 88
Implementation......Page 89
Implementation of Miro......Page 90
Acknowledgements......Page 110
Evaluating the user interface design......Page 91
Results......Page 92
Limitations of the evaluation......Page 93
Summary......Page 95
Acknowledgments......Page 96
CREO/MIRO......Page 97
Introduction......Page 98
Assumption: The "industry" can understand end users' work well enough to provide "routines" meeting the "exact needs" for "any given job"
......Page 99
Features of the Web-Active End User
......Page 396
Metadata authoring approaches......Page 102
Grammar-based interpreter......Page 103
Search result comparison......Page 250
Debugging and mixed-initiative interaction......Page 104
Applying filters to lenses......Page 105
Web objects in primitive actions......Page 324
What processes do participants do?......Page 106
Acknowledgments......Page 107
Sharing......Page 108
Summary......Page 109
Participants......Page 111
Automating frequent or hard-to-remember tasks
......Page 112
Automation limitations and issues......Page 113
Sharing limitations and issues......Page 114
General Issues and Future Work......Page 115
Summary......Page 116
CoScripter......Page 117
Introduction......Page 118
Introduction......Page 243
Interface walkthrough......Page 123
Results......Page 443
Content operations......Page 126
Identifying elements on a Web page......Page 128
Using the tutorial......Page 445
Untrusted widgets......Page 198
Integration with coscripter......Page 132
Informal user study......Page 133
Breadth and benefits......Page 134
Acknowledgments......Page 256
Acknowledgments......Page 138
Highlight......Page 139
Mixing the reactive with the personal: Opportunities for end user programming in personal information management (PIM)
......Page 140
Mental models......Page 142
Scenario: Social coordination......Page 144
Step 3: Triggering......Page 147
Testing copied code (or not)......Page 148
Specifying conditions for behavior execution......Page 149
Reminders about forgotten details......Page 150
Rule creation and management interface......Page 151
Adding predicates and actions......Page 152
Extending Atomate's schemas......Page 153
Summary......Page 154
Study 2: Rule creation......Page 155
Accuracy and ease of use......Page 156
Security, privacy, and spam......Page 367
Usefulness......Page 157
Ongoing work......Page 158
From pull to push: PubSubHubbub......Page 159
Discussion and conclusion......Page 160
Acknowledgments......Page 161
Atomate......Page 162
Mashups
......Page 163
Introduction......Page 165
Method......Page 166
An Accessible Guide......Page 167
Benefits......Page 299
A Closer Look At Online Information
......Page 170
Clipping......Page 172
Technology initiative......Page 173
Connecting......Page 175
Parameter identification......Page 326
Successes......Page 215
Formalized extraction of content......Page 178
Handling multiple scenarios in parallel......Page 179
Conclusion......Page 180
Improving tasks from execution failure......Page 331
C3W......Page 184
Programming in a MOO......Page 185
Example: Legroom for flight listings......Page 188
Overlay mashups......Page 189
Mashup suggestions......Page 190
Collaborative creation of web wrappers......Page 191
Example: Editing a wrapper for yelp......Page 194
The wrapper editor......Page 195
Summary......Page 200
Intel mash maker......Page 201
Programming by a sample: Leveraging Web sites to program their underlying services
......Page 202
Introduction......Page 315
Introduction......Page 296
Plow architecture......Page 318
The current situation: web development......Page 427
Intentions behind Web use......Page 206
Code invocation or black box reuse......Page 208
Authoring and maintaining the site-to-service map......Page 209
Server-side active wiki hosts and executes script......Page 210
Pasted material can be parameterized and edited......Page 211
Existing Web pages can be virtually edited......Page 212
MOOIDE......Page 349
Evaluation......Page 214
Multi-language scripting......Page 217
Metadata representation and Accessibility Commons
......Page 218
Tools for end user synthesis of Web experiences......Page 219
Uniting disparate accessibility metadata......Page 363
Limitations and future work......Page 220
Acknowledgments......Page 221
d.mix......Page 222
A World wider than the web......Page 223
Learning procedures from demonstration......Page 225
Parameter generalization......Page 226
External metadata and transcoding......Page 227
Visualizing and editing procedures......Page 228
Visualization using templates......Page 229
Predefined layout templates......Page 251
Support for editing errors or flaws......Page 233
Semantic mapping with PrimTL......Page 234
Information about understandability......Page 418
Web summaries......Page 235
Modeling human-level actions......Page 236
Source #3: Evidence based on code's prior uses......Page 237
Mixed-initiative learning......Page 238
Presenting suggestions to users......Page 385
Consistency in a heterogeneous environment......Page 239
Programmers rarely refine queries, but are good at it
......Page 240
ITL......Page 241
Visualization and Exploration
......Page 242
Overview......Page 244
System design......Page 245
Related work......Page 252
Discussion......Page 255
The temporal dimension in end user programming for the Web......Page 259
Crawler......Page 261
The Zoetrope engine......Page 262
Results of initial evaluations......Page 287
Zoetrope lenses......Page 264
Dynamic Script Generation......Page 265
Stacking lenses......Page 269
Timelines and movies......Page 270
Time series......Page 271
Exporting temporal data......Page 272
Zoetrope......Page 274
Introduction......Page 275
Supporting multiscenario web access with the recipesheet
......Page 277
Parallel retrieval......Page 281
Tentative composition......Page 285
Risks of cognitive overload: the paradox of choice......Page 286
Acknowledgments......Page 292
Recipesheet......Page 293
Natural Language
......Page 294
Web technology survey of Web users......Page 298
Code cloning or white box reuse......Page 300
CoScripter......Page 303
Inky......Page 305
CoScripter algorithm......Page 307
Step 1: Tokenize input......Page 308
Step 2: Recursive algorithm......Page 309
Explanatory power......Page 310
Limitations......Page 311
Future work......Page 312
Acknowledgments......Page 335
Inky......Page 314
Classic models of debugging......Page 316
Assumption: People can assemble programs from "black boxes"
......Page 412
Social collaborative debugging......Page 430
Task representation......Page 321
Task hierarchy......Page 327
Task invocation......Page 330
Evaluation......Page 332
Summary......Page 334
PLOW......Page 336
Knowing what you're talking about: Natural language programming of a multi-player online game 
......Page 337
Metafor......Page 339
A Dialog with MOOIDE......Page 340
Clipping......Page 342
Evaluation......Page 344
Accessibility
......Page 350
Introduction......Page 351
Collaborative authoring......Page 353
Semi automated authoring......Page 354
Manual approaches......Page 355
Conclusion and Future Directions......Page 357
Accessibility assessment and visualization
......Page 359
Collaborative crawling......Page 360
AxsJAX......Page 364
Social Accessibility pilot service
......Page 365
Challenges and future work......Page 366
Collaborating with content providers......Page 368
Summary......Page 369
Social accessibility......Page 370
Introduction......Page 371
Introduction......Page 392
Improving Web accessibility......Page 373
Recording and playback of how-to knowledge......Page 374
Formative Evaluation......Page 378
Example use case......Page 380
Suggestion types......Page 381
General suggestion component......Page 382
Similarity to task description......Page 383
Leveraging existing scripts for related tasks......Page 384
Evaluation of Suggestions......Page 386
Discussion......Page 387
Summary......Page 388
Trailblazer......Page 390
User Studies
......Page 391
The status quo: who actually builds mashups?......Page 393
Online activities......Page 406
Technology expertise......Page 407
Introduction......Page 409
Reuse: Vision Versus Reality......Page 410
Forms of Reuse in the End User Programming Context......Page 413
Template reuse or conceptual reuse......Page 414
Low-Ceremony Evidence of Reusable End User Code
......Page 415
Source #1: Evidence based on the code itself
......Page 416
Source #2: Evidence based on code's authorship......Page 419
Predicting Code Reuse Based On Low-Ceremony Evidence......Page 420
Acknowledgments......Page 423
Introduction......Page 424
Yahoo! pipes......Page 429
Worked examples of social debugging from Yahoo Pipes
......Page 435
Conclusions......Page 439
Introduction......Page 440
Study 1: Opportunistic programming in the lab
......Page 442
Using the Web to debug......Page 446
Study 2: Web search log analysis......Page 447
Method......Page 448
Results......Page 449
Conclusions and future work......Page 451
Acknowledgments......Page 452
References
......Page 453
A......Page 473
C......Page 474
D......Page 476
G......Page 477
I......Page 478
M......Page 479
N......Page 480
P......Page 481
S......Page 482
T......Page 483
W......Page 484
Z......Page 486