Survey methodology / Robert M. Groves ... [and others].

Format:

Book

Contributor:

Groves, Robert M.

Harry E. Humphreys Book Fund.

Series:

Wiley series in survey methodology

Language:

English

Subjects (All):

Surveys--Methodology.

Surveys.

Social surveys--Methodology.

Social surveys.

Social sciences--Research--Statistical methods.

Social sciences.

Physical Description:

xix, 424 pages : illustrations ; 26 cm.

Place of Publication:

Hoboken, NJ : J. Wiley, [2004]

Summary:

An accessible introduction to the science and application of sample surveys Over the past two decades, survey research has evolved significantly. Survey Methodology describes the basic principles of survey design discovered in methodological research over recent years and offers guidance for making successful decisions in the design and execution of high quality surveys. Written by six nationally recognized experts in the field, this book covers the major considerations in designing and conducting a sample survey. Topical, accessible, and succinct, this book represents the state of the science in survey methodology. Employing the "total survey error" paradigm as an organizing framework, it merges the science of surveys with state-of-the-art practices. End-of-chapter terms, references, and exercises enhance its value as a reference for practitioners and as a text for advanced students.

Contents:

1.2 A Brief History of Survey Research 3

1.2.1 The Purposes of Surveys 3

1.2.2 The Development of Standardized Questioning 5

1.2.3 The Development of Sampling Methods 6

1.2.4 The Development of Data Collection Methods 7

1.3 Some Examples of Ongoing Surveys 7

1.3.1 The National Crime Victimization Survey 8

1.3.2 The National Survey on Drug Use and Health 13

1.3.3 The Survey of Consumers 17

1.3.4 The National Assessment of Educational Progress 20

1.3.5 The Behavioral Risk Factor Surveillance System 24

1.3.6 The Current Employment Statistics Program 27

1.3.7 What Can We Learn From the Six Example Surveys? 29

1.5 The Challenge of Survey Methodology 32

Chapter 2. Inference and Error in Surveys

2.2 The Lifecycle of a Survey From a Design Perspective 41

2.2.1 Constructs 41

2.2.2 Measurement 43

2.2.3 Response 43

2.2.4 Edited Response 44

2.2.5 The Target Population 44

2.2.6 The Frame Population 45

2.2.7 The Sample 45

2.2.8 The Respondents 45

2.2.9 Postsurvey Adjustments 46

2.2.10 How Design Becomes Process 47

2.3 The Lifecycle of a Survey from A Quality Perspective 49

2.3.1 The Observational Gap between Constructs and Measures 50

2.3.2 Measurement Error: The Observational Gap between the Ideal Measurement and the Response Obtained 51

2.3.3 Processing Error: the Observational Gap between the Variable Used in Estimation and that Provided by the Respondent 53

2.3.4 Coverage Error: the Nonobservational Gap between the Target Population and the Sampling Frame 54

2.3.5 Sampling Error: The Nonobservational Gap between the Sample and the Sampling Frame 57

2.3.6 Nonresponse Error: The Nonobservational Gap between the Sampling and the Respondent Pool 58

2.3.7 Adjustment Error 59

2.5 Error Notions in Different Kinds of Statistics 61

Chapter 3. Target Populations, Sampling Frames, and Coverage Error

3.2 Populations and Frames 67

3.3 Coverage Properties of Sampling Frames 70

3.3.1 Undercoverage 70

3.3.2 Ineligible Units 74

3.3.3 Clustering of Target Population Elements Within Frame Elements 75

3.3.4 Duplication of Target Population Elements in Sampling Frames 77

3.3.5 Complicated Mappings between Frame and Target Population Elements 78

3.4 Common Target Populations and Their Frame Issues 79

3.4.1 Households and Persons 79

3.4.2 Customers, Employees, or Members of an Organization 80

3.4.3 Organizations 81

3.4.4 Events 82

3.4.5 Rare Populations 83

3.5 Coverage Error 83

3.6 Reducing Undercoverage 84

3.6.1 The Half-Open Interval 84

3.6.2 Multiplicity Sampling 86

3.6.3 Multiple Frame Designs 87

3.6.4 Increasing Coverage While Including More Ineligible Elements 90

Chapter 4. Sample Design and Sampling Error

4.2 Samples and Estimates 95

4.3 Simple Random Sampling 99

4.4 Cluster Sampling 102

4.4.1 The Design Effect and Within-Cluster Homogeneity 105

4.4.2 Subsampling within Selected Clusters 108

4.5 Stratification and Stratified Sampling 109

4.5.1 Proportionate Allocation to Strata 111

4.5.2 Disproportionate Allocation to Strata 117

4.6 Systematic Selection 118

4.7 Complications in Practice 121

4.7.1 Two-Stage Cluster Designs with Probabilities Proportionate to Size (PPS) 122

4.7.2 Multistage and Other Complex Designs 124

4.7.3 How Complex Sample Designs are Described: The Sample Design for the NCVS 125

4.8 Sampling Persons in US Telephone Households 128

Chapter 5. Methods of Data Collection

5.1 Alternative Methods of Data Collection 138

5.1.1 Degree of Interviewer Involvement 141

5.1.2 Degree of Interaction with the Respondent 142

5.1.3 Degree of Privacy 142

5.1.4 Channels of Communication 143

5.1.5 Technology Use 145

5.1.6 Implications of these Dimensions 145

5.2 Choosing the Appropriate Method 146

5.3 Effects of Different Data Collection Methods on Survey Errors 147

5.3.1 Measuring the Marginal Effect of Mode 148

5.3.2 Sampling Frame and Sample Design Implications of Mode Selection 150

5.3.3 Coverage Implications of Mode Selection 150

5.3.4 Nonresponse Implications of Mode Selection 153

5.3.5 Measurement Quality Implications of Mode Selection 155

5.3.6 Cost Implications 160

5.3.7 Summary on the Choice of Method 162

5.4 Using Multiple Modes of Data Collection 163

Chapter 6. Nonresponse in Sample Surveys

6.2 Three Major Types of Unit Nonresponse 169

6.2.1 Unit Nonresponse Due to Failure to Deliver the Survey Request 170

6.2.2 Unit Nonresponse Due to Refusals 173

6.2.3 Unit Nonresponse Due to the Inability to Provide the Requested Data 178

6.3 How Does Nonresponse Affect the Quality of Survey Statistics? 178

6.4 Computing Response and Nonresponse Rates 181

6.5 Trends in Response Rates over Time 184

6.6 Item Nonresponse 187

6.7 Design Features to Reduce Unit Nonresponse 189

Chapter 7. Questions and Answers in Surveys

7.1 Alternatives Methods of Survey Measurement 201

7.2 Cognitive Processes in Answering Questions 202

7.2.1 Comprehension 204

7.2.2 Retrieval 205

7.2.3 Estimation and Judgment 206

7.2.4 Reporting 207

7.2.5 Other Models of the Response Process 207

7.3 Problems in Answering Survey Questions 209

7.3.1 Encoding Problems 209

7.3.2 Misinterpreting the Questions 210

7.3.3 Forgetting and Other Memory Problems 213

7.3.4 Estimation Processes for Behavioral Questions 218

7.3.5 Judgment Processes for Attitude Questions 220

7.3.6 Formatting the Answer 221

7.3.7 Motivated Misreporting 224

7.3.8 Navigational Errors 225

7.4 Guidelines for Writing Good Questions 226

7.4.1 Nonsensitive Questions About Behavior 227

7.4.2 Sensitive Questions About Behavior 230

7.4.3 Attitude Questions 232

7.4.4 Self-Administered Questions 235

Chapter 8. Evaluating Survey Questions

8.2 Expert Reviews 242

8.3 Focus Groups 243

8.4 Cognitive Interviews 245

8.5 Field Pretests and Behavior Coding 247

8.6 Randomized or Split-Ballot Experiments 249

8.7 Applying Question Standards 250

8.8 Summary of Question Evaluation Tools 251

8.9 Linking Concepts of Measurement Quality to Statistical Estimates 254

8.9.1 Validity 254

8.9.2 Response Bias 258

8.9.3 Reliability and Simple Response Variance 261

Chapter 9. Survey Interviewing

9.1 The Role of the Interviewer 269

9.2 Interviewer Bias 270

9.2.1 Systematic Interviewer Effects on Reporting of Socially Undesirable Attributes 270

9.2.2 Systematic Interviewer Effects on Topics Related to Observable Interviewer Traits 270

9.2.3 Systematic Interviewer Effects Associated with Interviewer Experience 272

9.3 Interviewer Variance 274

9.3.1 Randomization Requirements for Estimating Interviewer Variance 274

9.3.2 Estimation of Interviewer Variance 275

9.4 Strategies for Reducing Interviewer Bias 278

9.4.1 The Role of the Interviewer in Motivating Respondent Behavior 278

9.4.2 Changing Interviewer Behavior 279

9.5 Strategies for Reducing Interviewer-Related Variance 280

9.5.1 Minimizing Questions that Require Nonstandard Interviewer Behavior 281

9.5.2 Professional, Task-Oriented Interviewer Behavior 283

9.5.3 Interviewers Reading Questions as They Are Worded 284

9.5.4 Interviewers Explaining the Survey Process to the Respondent 284

9.5.5 Interviewers Probing Nondirectively 286

9.5.6 Interviewers Recording Answers Exactly as Given 289

9.5.7 Summary on Strategies to Reduce Interviewer Variance 290

9.6 The Controversy About Standardized Interviewing 290

9.7 Interviewer Management 293

9.7.1 Interviewer Selection 293

9.7.2 Interviewer Training 294

9.7.3 Interviewer Supervision and Monitoring 295

9.7.4 The Size of Interviewer Workloads 296

9.7.5 Interviewers and Computer Use 296

Chapter 10. Postcollection Processing of Survey Data

10.2 Coding 305

10.2.1 Practical Issues of Coding 306

10.2.2 Theoretical Issues in Coding

Activities 308

10.2.3 "Field Coding"

An Intermediate Design 308

10.2.4 Standard Classification Systems 311

10.2.5 Other Common Coding Systems 315

10.2.6 Quality Indicators in Coding 316

10.2.7 Summary of Coding 318

10.3 Entering Numeric Data into Files 318

10.4 Editing 319

10.5 Weighting 321

10.5.1 Weighting with a First-Stage Ratio Adjustment 322

10.5.2 Weighting for Differential Selection Probabilities 323

10.5.3 Weighting to Adjust for Unit Nonresponse 324

10.5.4 Poststratification Weighting 326

10.5.5 Putting All the Weights Together 326

10.6 Imputation for Item-missing data 329

10.7 Sampling Variance Estimation for Complex Samples 333

10.8 Survey Data Documentation and Metadata 337

10.9 Summary of Postsurvey Processing 340

Chapter 11. Principles and Practices Related to Scientific Integrity

11.2 Standards for the Conduct of Research 345

11.3 Standards for Dealing with Clients 348

11.4 Standards for Dealing with the Public 349

11.5 Standards for Dealing with Respondents 350

11.5.1 Legal Obligations to Survey Respondents 350

11.5.2 Ethical Obligations to Respondents 351

11.5.3 Informed Consent: Respect for Persons 353

11.5.4 Beneficence: Protecting Respondents from Harm 355

11.5.5 Efforts at Persuasion 357

11.6 Emerging Ethical Issues 358

11.7 Practices in Research Administration Regarding Human Subject Issues 358

11.8 Research About Informed Consent Protocols in Surveys 360

11.8.1 Research on Respondents' Reactions to the Content of Informed Consent Protocols 360

11.8.2 Research on Informed Consent Complications in Survey Methodological Studies 364

11.8.3 Research on Written versus Oral Informed Consent 365

11.8.4 Summary of Research on Informed Consent in Surveys 366

11.9 Procedures to Detect and Repair Interviewer Falsification 366

11.10 Disclosure Limitation Procedures 368

11.10.1 Administrative Procedures to Limit Identifiability of Survey Materials 368

11.10.2 Restricting Access to the Data Only to Those Subscribing to a Pledge of Confidentiality 368

11.10.3 Restricting the Contents of the Survey Data That May Be Released 370.

Notes:

"Wiley-Interscience."

Includes bibliographical references (pages 391-413) and index.

Local Notes:

Acquired for the Penn Libraries with assistance from the Harry E. Humphreys Book Fund.

ISBN:

0471483486

OCLC:

54374549

Online:

Contributor biographical information

Publisher description