Elasticsearch Server

Cover......Page 1
Copyright......Page 3
Credits......Page 4
About the Author......Page 5
Acknowledgments......Page 6
About the Author......Page 7
Acknowledgments......Page 8
About the Reviewers......Page 9
www.PacktPub.com......Page 12
Table of Contents......Page 14
Preface......Page 26
Chapter 1: Getting Started With the Elasticsearch Cluster......Page 32
The Lucene glossary and architecture......Page 33
Indexing and querying......Page 35
Scoring and query relevance......Page 36
Document......Page 37
Mapping......Page 38
Replica......Page 39
Indexing and searching......Page 40
Installing Elasticsearch......Page 42
The directory layout......Page 43
Configuring Elasticsearch......Page 44
Running Elasticsearch......Page 45
Shutting down Elasticsearch......Page 47
Elasticsearch as a system service on Linux......Page 48
Manipulating data with the REST API......Page 49
Creating a new document......Page 50
Retrieving documents......Page 52
Updating documents......Page 53
Versioning......Page 55
Using the version provided by external system......Page 56
Sample data......Page 57
The ElasticSearch query response......Page 58
Query analysis......Page 60
URI query string parameters......Page 62
The Lucene query syntax......Page 66
Summary......Page 67
Elasticsearch indexing......Page 68
Shards and replicas......Page 69
Creating indices......Page 70
Settings for a newly created index......Page 71
Type determining mechanism......Page 72
Disabling field type guessing......Page 74
Index structure mapping......Page 75
Type definition......Page 76
Core types......Page 77
The IP address type......Page 82
Using analyzers......Page 83
Different similarity models......Page 88
Setting per-field similarity......Page 89
Available similarity models......Page 90
Postings format......Page 91
Configuring the postings format......Page 92
Configuring the doc values......Page 93
Preparing data for bulk indexing......Page 94
Indexing the data......Page 95
Even quicker bulk requests......Page 97
Identifier fields......Page 98
The _type field......Page 99
The _all field......Page 100
Exclusion and inclusion......Page 101
The _size field......Page 102
The _timestamp field......Page 103
The _ttl field......Page 104
Introduction to segment merging......Page 105
The merge policy......Page 106
The merge factor......Page 107
Introduction to routing......Page 108
Default indexing......Page 109
Default searching......Page 110
Routing......Page 111
The routing parameters......Page 113
Routing fields......Page 114
Summary......Page 115
Querying Elasticsearch......Page 116
The example data......Page 117
A simple query......Page 119
Paging and result size......Page 120
Returning the version value......Page 121
Limiting the score......Page 122
Choosing the fields that we want to return......Page 123
Using the script fields......Page 125
Understanding the querying process......Page 127
Query logic......Page 128
Search types......Page 129
Search execution preferences......Page 130
The Search shards API......Page 131
The term query......Page 133
The terms query......Page 134
The common terms query......Page 135
The Boolean match query......Page 137
The match_phrase_prefix query......Page 139
The multi_match query......Page 140
The query_string query......Page 141
The simple_query_string query......Page 143
The identifiers query......Page 144
The prefix query......Page 145
The fuzzy_like_this query......Page 146
The fuzzy query......Page 147
The wildcard query......Page 149
The more_like_this query......Page 150
The more_like_this_field query......Page 151
The range query......Page 152
The dismax query......Page 153
Compound queries......Page 154
The bool query......Page 155
The boosting query......Page 156
The constant_score query......Page 157
The indices query......Page 158
Using filters......Page 159
The range filter......Page 161
The exists filter......Page 162
The script filter......Page 163
The identifiers filter......Page 164
If this is not enough......Page 165
Combining filters......Page 166
Named filters......Page 168
Caching filters......Page 171
Highlighting......Page 172
Getting started with highlighting......Page 173
Under the hood......Page 174
Configuring HTML tags......Page 175
Global and local settings......Page 176
Require matching......Page 177
The postings highlighter......Page 180
Using the validate API......Page 183
Default sorting......Page 186
Selecting fields used for sorting......Page 187
Specifying the behavior for missing fields......Page 189
Dynamic criteria......Page 190
An example of the rewrite process......Page 191
Query rewrite properties......Page 193
Summary......Page 194
Indexing tree-like structures......Page 196
Data structure......Page 197
Analysis......Page 198
Data......Page 199
Mappings......Page 200
Final mappings......Page 201
Sending the mappings to Elasticsearch......Page 202
Using nested objects......Page 203
Using the parent-child relationship......Page 207
Child mappings......Page 208
Querying......Page 209
Querying data in the child documents......Page 210
Querying data in the parent documents......Page 212
Performance considerations......Page 213
Adding a new field......Page 214
Modifying fields......Page 215
Summary......Page 217
An introduction to Apache Lucene scoring......Page 218
Default scoring formula......Page 219
Relevancy matters......Page 220
Objects available during script execution......Page 221
Using other languages......Page 223
Using native code......Page 224
Handling languages differently......Page 227
Detecting the language of the documents......Page 228
The mappings......Page 229
Queries with the identified language......Page 231
Queries with unknown languages......Page 232
Combining queries......Page 233
Adding boost to queries......Page 234
The constant_score query......Page 237
The function_score query......Page 238
Deprecated queries......Page 244
Defining field boosting in input data......Page 247
Words with the same meaning......Page 248
Synonyms in the mappings......Page 249
Using Apache Solr synonyms......Page 250
Understanding field analysis......Page 252
Explaining the query......Page 254
Summary......Page 256
Aggregations......Page 258
General query structure......Page 259
Metric aggregations......Page 261
Bucketing......Page 265
Nesting aggregations......Page 280
Global and subsets......Page 283
Inclusions and exclusions......Page 286
Document structure......Page 287
Returned results......Page 288
Using queries for faceting calculations......Page 289
Using filters for faceting calculations......Page 290
Terms faceting......Page 291
Ranges based faceting......Page 293
Choosing different fields for an aggregated data calculation......Page 295
Numerical and date histogram faceting......Page 296
Computing numerical field statistical data......Page 297
Computing statistical data for terms......Page 299
Geographical faceting......Page 301
Memory considerations......Page 302
Including suggestions......Page 303
The suggester response......Page 304
The term suggester configuration options......Page 306
Additional term suggester options......Page 307
The phrase suggester......Page 308
The completion suggester......Page 309
The index......Page 314
Percolator preparation......Page 315
Getting deeper......Page 318
Indexed documents percolation......Page 321
Handling files......Page 322
Adding additional information about the file......Page 325
Mappings preparation for spatial search......Page 326
Distance-based sorting......Page 327
Bounding box filtering......Page 329
Limiting the distance......Page 331
Arbitrary geo shapes......Page 332
Polygon......Page 333
An example usage......Page 334
Storing shapes in the index......Page 336
The scroll API......Page 337
Scrolling to the rescue......Page 338
The terms filter......Page 341
Terms lookup......Page 342
The terms lookup query structure......Page 345
Summary......Page 346
Node discovery......Page 348
The master node......Page 349
The master-election configuration......Page 350
Configuring multicast......Page 351
Ping settings for nodes......Page 352
Recovery control......Page 353
Additional gateway recovery options......Page 354
The field data cache and circuit breaker......Page 355
The store......Page 356
The index refresh rate......Page 357
The thread pool configuration......Page 358
Combining it all together – some general advice......Page 359
The index refresh rate......Page 360
The field data cache and breaking the circuit......Page 361
Tuning transaction logging......Page 362
An example of a template......Page 363
Storing templates in files......Page 364
Dynamic templates......Page 365
Field definitions......Page 366
Summary......Page 367
The Elasticsearch time machine......Page 368
Creating a snapshot repository......Page 369
Creating snapshots......Page 370
Additional parameters......Page 371
Restoring a snapshot......Page 372
The cluster health API......Page 373
Additional parameters......Page 374
The indices stats API......Page 375
Store......Page 376
Indexing, get, and search......Page 377
The nodes info API......Page 378
The nodes stats API......Page 380
Cluster state API......Page 381
The cat API......Page 382
Limiting returned information......Page 383
Cluster being ready......Page 384
Controlling the number of primary shards initialized concurrently on a single node......Page 385
Controlling shard and replica allocation......Page 386
Index creation......Page 387
Excluding nodes from allocation......Page 388
Disk-based shard allocation......Page 389
Moving shards and replicas manually......Page 391
Canceling shard allocation......Page 392
Multiple commands per HTTP request......Page 393
Defining a new warming query......Page 394
Retrieving the defined warming queries......Page 396
Choosing queries......Page 397
Creating an alias......Page 399
Combining commands......Page 400
Filtering aliases......Page 401
Aliases and routing......Page 402
The basics......Page 403
Installing plugins......Page 404
The update settings API......Page 405
Summary......Page 406
Index......Page 408