Introduction to search with Sphinx: from installation to relevance tuning

Copyright......Page 8
Table of Contents......Page 9
Preface......Page 13
Organization of This Book......Page 14
We’d Like to Hear from You......Page 15
Safari® Books Online......Page 16
Acknowledgments......Page 17
Terms and Concepts in Search......Page 19
Thinking in Documents Versus Databases......Page 20
Query Languages......Page 21
Full-text queries......Page 22
Differences between logical and full-text searches......Page 23
From Text to Words......Page 24
Linguistics Crash Course......Page 25
Relevance, As Seen from Outer Space......Page 27
Full-Text Indexes......Page 28
Kinds of Data......Page 30
Full-Text Indexes and Attributes......Page 31
Approaches to Searching......Page 32
Kinds of Results......Page 33
Workflow Overview......Page 35
Getting Started ... in a Minute......Page 37
Defining Data Sources......Page 41
Disk-based indexes......Page 42
RT indexes......Page 44
Declaring Fields and Attributes in SQL Data......Page 45
Managing Configurations with Inheritance and Scripting......Page 48
Using SphinxAPI......Page 50
Using SphinxQL......Page 52
Quick Build......Page 55
Configuring Sources and Building Binaries......Page 56
Main Fetch Query......Page 59
Pre-Queries, Post-Queries, and Post-Index Queries......Page 60
How the Various SQL Queries Work Together......Page 61
Ranged Queries for Larger Data Sets......Page 62
Indexing XML Data......Page 63
Index Schemas for XML Data......Page 64
XML Encodings......Page 65
xmlpipe2 Elements Reference......Page 66
Working with Character Sets......Page 67
Handling Stop Words and Short Words......Page 71
Matching Modes......Page 75
Known Operators......Page 78
Escaping Special Characters......Page 80
AND and OR Operators and a Notorious Precedence Trap......Page 81
Field Limit Operator......Page 82
Phrase Operator......Page 84
Keyword Proximity Operator......Page 85
Strict Order (BEFORE) Operator......Page 86
SENTENCE and PARAGRAPH Operators......Page 88
ZONE Limit Operator......Page 89
Keyword Modifiers......Page 90
Result Set Contents and Limits......Page 91
Searching Multiple Indexes......Page 97
Result Set Processing......Page 99
Expressions......Page 100
Filtering......Page 103
Sorting......Page 105
Grouping......Page 107
The “Divide and Conquer” Concept......Page 111
Index Rotation......Page 113
Picking Documents......Page 115
Handling Updates and Deletions with K-Lists......Page 118
Scheduling Rebuilds, and Using Multiple Deltas......Page 123
Merge Versus Rebuild Versus Deltas......Page 124
Scripting and Reloading Configurations......Page 127
Relevance Assessment: A Black Art......Page 129
Relevance Ranking Functions......Page 133
BM25 Factor......Page 136
Phrase Proximity Factor......Page 138
Overview of the Available Rankers......Page 139
Nitty-gritty Ranker Details......Page 140
How Do I Draw Those Stars?......Page 142
How Do I Force Document D to Rank First?......Page 143
Where to Go from Here......Page 144