"Proof," policy, and practice : understanding the role of evidence in improving education / Paul E. Lingenfelter ; foreword by Michael S. McPherson.

Format:

Book

Author/Creator:

Lingenfelter, Paul E., author.

Language:

English

Subjects (All):

Education--Research--United States.

Education.

Education--Research.

United States.

Educational change--United States.

Educational change.

Education and state--United States.

Education and state.

School improvement programs--United States.

School improvement programs.

Physical Description:

xx, 260 pages ; 23 cm

Edition:

First edition.

Place of Publication:

Sterling, Virginia : Stylus Publishing, LLC., 2016.

Summary:

Paul E. Lingenfelter offers educational researchers and policy makers a framework for considering such questions as: What problems are important and accessible? What methods will be fruitful? How can policy makers and practitioners make choices and learn how to improve? This illuminating introduction to the use of research for problem-solving concludes by suggesting emerging practices and approaches that can help scholars, practitioners, and policy leaders become more successful in reaching their fundamental goals. Book jacket.

Contents:

1 Proof and Policy 9

Usable Knowledge in Everyday Life-The Modest Role of Science 10

Scientific "Proof" From the Perspective of a "Hard" Scientist 13

Can We Find Proof in Policy and Practice? 15

What About the Potential of Big Data? 18

Challenges in Applying Scientific Knowledge to Practice 19

Research for Fundamental Understanding and Research for Use 21

Utility Without Proof: Scholarship for Policy and Practice 23

Notes 23

2 Experimentation and Program Evaluation 25

Evidence-Based Policy Using the Experimental Method 26

Campbell and Stanley on Experimental and Quasi-Experimental Research 28

Experimental Program Evaluation, Evaluated 29

The What Works Clearinghouse 29

MDRC 31

Why Isn't Experimentation More Conclusive and Productive? 33

A Realist Approach for Evaluating Interventions 38

Observations from the Case of Success for All 40

Turning Gold into Lead? 43

Notes 45

3 Measurement 49

Measuring Up: State Performance in Postsecondary Education 51

Measuring Up's Theory of Change 52

The Strategy and Its Implementation 52

Testing the Theory of Change 56

Policy-Makers' Responses to Measuring Up 57

Data Quality Data Standards, Data Systems 59

Measuring Student Learning: Fundamental Concepts and Issues 63

Common Core State Standards for College and Career Readiness 67

The Impetus for the Common Core 67

Development and Implementation Thus Far 68

Reflections on the Historical Context of the Common Core 70

Assessing Higher Education Learning Outcomes (AHELO) 73

Can Postsecondary Knowledge and Skill Be Assessed on an International Scale? 75

Can Student Performance Be Directly Assessed at a Global Level With Valid Results Across Diverse Cultures, Languages, and Different Types of Institution? 75

Can a "Low-Stakes" Voluntary International Comparative Assessment Provide Higher Education Institutions With Feedback They Can Use to Foster Improvement in Student Learning Outcomes? 76

Notes 77

4 Measurement: Fit for which Purposes? 82

The Educational Data Movement 83

The Controversial Postsecondary Student Unit-Record System 84

Data Ownership and the Right to Privacy for Individuals and Institutions 86

Differentiating Policy and Practice 90

Data and Measurement Guidelines: For Policy, Public Use, and Practice 94

Fitness for Purpose: Legitimate and Effective Uses of Measurement 98

Measuring Up 99

Expansive Student-Level Data Systems and Common Education Data Standards 101

Common Core State Standards for College and Career Readiness 102

Assessment of Higher Education Learning Outcomes (AHELO) 105

Concluding Thoughts on the Assessment of Learning 106

Notes 107

5 Getting Better: The Use of Evidence in Practice 110

Technical Rationality and Reflective Practice 111

Qualitative Research 113

Improvement Science in Medicine 116

Networked Improvement Communities: Improvement Science in Education 118

Understanding the Problem in Systemic Terms 121

Establishing Clear, Measurable Goals for Improvement 125

Developing and Testing Theories of Action to Generate Improvement 127

Analyzing Results to Guide Subsequent Action 129

A Continuous Cycle of Learning and Improved Performance 129

What Is Evidence-Based Practice? How Can It Improve Outcomes? 132

The Complexity of the Situation 133

The Relevance of Evidence to the Situation 134

The Quality of Evidence and Measurement 135

The Ability of the Practitioner to Use Evidence 136

Concluding Thoughts on Using Evidence to Improve Practice 139

Notes 140

6 Research and Evidence In Government and Organizations 144

Influence, Interests, Views, Information, Negotiation, Knowledge 144

Influence 144

Interests 145

Views 146

Information 147

Negotiation 148

Knowledge 150

The Essential Role of Measurement 151

The Politicization of Educational Policy 152

The Culture Wars 152

Markets, Hierarchy, Bureaucracy, and Pluralism 153

Conflict Among Special Interests 155

Social Justice: Income, Class, Opportunity, and Privilege 156

What Education Studies Are Influential in Political Environments? 157

Consequential and Less-Consequential Research 160

Resistance to Dissonant Information 161

Sorting Through Elusive Connections Between Cause and Effect 162

Tailoring Inquiry to the Decision-Making System 167

Realistic, operational decision options 168

Focus on salient, significant issues 169

Reasonable accessibility 170

Locally focused data and analysis 171

Focus on nontrivial effects 173

Concluding Thoughts on Research, Evidence, and the Politicization of Education 174

Notes 174

7 What Works, When, and How: Reflections, Observations, and Opinions 178

Shaping Policy and Practice-Not Changing Worldviews 178

Undesirable Variation: The Core Issue in Most- Complex Social Problems 180

Measuring for Improvement, Despite the Land Mines 182

Uses of Measurement in Educational Policy 184

Uses of Measurement in Educational Practice 185

Understanding the System: The Case of Research on Chicago Schools 190

Comparable, Valid Measurement of Crucial Outcome Variables 191

Probing to Discover the Drivers of Improvement 192

The Utility of Research Findings 193

Harnessing, Not Fighting, Human Agency in Accountability for Improvement 194

Balancing Measurement for Improvement and Accountability 196

Illuminating Fundamental Issues of Practice 198

Using Data Analytics to Improve Performance 200

Employing Financial Supports, Incentives, and Sanctions 201

Supporting Existing Capabilities and Developing Capabilities 205

Motivating With Incentives and Enabling With Necessary Financial Resources 205

Avoiding Perverse Incentives and Unproductive Expenditures 206

Monitoring Outcomes and Adapting Policy to Improve 208

Aligning Policy and Practice in Partnership 209

In Conclusion 212

Pitfalls to Avoid 214

Unlocking the Potential of Evidence for Improvement 215

Notes 216.

Notes:

Includes bibliographical references and index.

ISBN:

9781579227500

1579227503

9781579227517

1579227511

OCLC:

917346383