Understanding and evaluating search experience / Maria Stone.

Format:

Book

Author/Creator:

Stone, Maria, author.

Series:

Synthesis Lectures on Information Concepts, Retrieval, and Services ; 77

Language:

English

Subjects (All):

Search engines.

Physical Description:

1 online resource (100 pages) : illustrations

Place of Publication:

Cham, Switzerland : Springer, [2022]

System Details:

Mode of access: World Wide Web.

Summary:

This book is intended for anyone interested in learning more about how search works and how it is evaluated. We all use search-it's a familiar utility. Yet, few of us stop and think about how search works, what makes search results good, and who, if anyone, decides what good looks like. Search has a long and glorious history, yet it continues to evolve, and with it, the measurement and our understanding of the kinds of experiences search can deliver continues to evolve, as well. We will discuss the basics of how search engines work, how humans use search engines, and how measurement works. Equipped with these general topics, we will then dive into the established ways of measuring search user experience, and their pros and cons. We will talk about collecting labels from human judges, analyzing usage logs, surveying end users, and even touch upon automated evaluation methods. After introducing different ways of collecting metrics, we will cover experimentation as it applies to search evaluation. The book will cover evaluating different aspects of search-from search user interface (UI), to results presentation, to the quality of search algorithms. In covering these topics, we will touch upon many issues in evaluation that became sources of controversy-from user privacy, to ethical considerations, to transparency, to potential for bias. We will conclude by contrasting measuring with understanding, and pondering the future of search evaluation.

Contents:

Understanding and evaluating search experience

Abstract

Keywords

Contents

Acknowledgments

Chapter 1: Introduction

Chapter 2: How Search Engines Work

Chapter 3: How Searchers Think About Search

Chapter 4: How Measurement Works

Chapter 5: Components of Search that Can Be Evaluated

Chapter 6: Units of Analysis: Query, Task, User

Chapter 7: Types of Metrics for Search Evaluation

Chapter 8: Experimentation (a.k.a. AB Testing)

Chapter 9: What Gets Left Out: Understanding vs. Measuring

References

Author’s Biography.

Notes:

Includes bibliographical references and index.

Description based on print version record.

ISBN:

9783031792168

3031792165