Principles-focused evaluation : the guide / Michael Quinn Patton.

Format:

Book

Author/Creator:

Patton, Michael Quinn, author.

Language:

English

Subjects (All):

Evaluation research (Social action programs).

Social service--Research.

Social service.

Physical Description:

1 online resource (463 pages) : illustrations, tables

Edition:

1st ed.

Place of Publication:

New York, New York ; London, [England] : The Guilford Press, 2018.

Summary:

How can programs and organizations ensure they are adhering to core principles--and assess whether doing so is yielding desired results?From evaluation pioneer Michael Quinn Patton, this book introduces the principles-focused evaluation (P-FE) approach and demonstrates its relevance and application in a range of settings.

Contents:

Cover

Half Title Page

Also from Michael Quinn Patton

Title Page

Copyright

Dedication

Preface

Contents

List of Exhibits

Part I. Principles

1. First Principles

First Principles First

Natural Principles versus Human Guidance Principles

Principles Can and Should Be Evaluated

Practice Exercise: Your Baseline

2. Effectiveness Principles

What?

Why?

When?

How?

Who?

Where?

Principles in Simple, Complicated, and Complex Situations and Interventions

Practice Exercise

3. Examples of Principles‑Driven Change Initiatives and Programs

Principles‑Driven Programs

4. Evaluating Principles

What Evaluators Do Well

What We Aim to Do, and Know We Should Do, but Are Still Learning to Do Well

Emergent Challenges for Evaluation

5. The Niche and Nature of Principles‑Focused Evaluation Serving Diverse Purposes

Utilization‑Focused Evaluation

Developmental Evaluation

Principles‑Focused Evaluation

Comparing Principles of Utilization-Focused Evaluation, Developmental Evaluation, and Principles-Focused Evaluation

Part II. GUIDE

6. GUIDE for Effectiveness Principles

The Up‑Front Clarifying Role of Evaluators

Elucidating the GUIDE Criteria and an Example Applying the Criteria

SMART Goals Compared to GUIDE Principles

G. Guiding

7. Guidance for Developing and Distinguishing Principles

Quick Review

Principles versus Rules and Recipes

The Rules Test for Clarifying Principles

The Alternative Principles Test to Enhance Clarity

Evaluating Opposites in Principles‑Focused Evaluation

Chapter Summary

8. Referring to Something as a Principle Doesn't Make It One: Further Guidance on Distinguishing Effectiveness Principles.

Good Examples of Bad Examples

Exemplary Principles

Semantic Principles

Alleged Principles That on Closer Examination Aren't

9. Still More Guidance on Developing and Distinguishing Principles: Principles Derived from and Contrasted with Assumptions, Truths, and Lessons

Identifying, Generating, Developing, and Articulating Principles

Assumptions about Skillful Teaching

From Lessons to Principles

Stephen D. Brookfield Responds

Lessons about Developing and Evaluating Principles Basedon Working with Stephen Brookfield's Adult Education Writings

Practice Exercises

10. Conceptual Triangulation: Evaluating the Similarities of Parallel Principles

Cooperative Extension and Evaluation: Parallel Principles

Common Principles, One List

The Value of Comparisons

11. Holistic, Sequential, and Pole Star Approaches to Principles

Holistic Set of Principles

Sequential Principles

Pole Star Principles

Advanced Practice Exercise

U. Useful

12. Principles Point the Way to Desired Results

Establishing a Baseline for Assessing Change

Youth Homelessness Programs

Principles Can Integrate Processes and Outcomes

Reframing Processes and Outcomes

Conclusion

13. Diverse Uses of Principles across an Organization

Serving Homeless Youth

Transitioning to a Principles-Driven Organization

Developing a Shared Vision

14. Evaluating the Utility of Research‑Derived Principles for Enhancing Online Learning

How to Approach and Evaluate a Set of Principles for Utility

Research Origins of the TEC-VARIETY Principles

From Research‑Derived Principles to Principles‑Focused Evaluation

Evaluating the Principles

I. Inspiring

15. Inspirational Principles Are Infused with Values.

The Personal Factor: Principles‑Driven People

Inspirational Principles Grounded in Deeply Held Values

Outcomes‑Based versus Principles‑Based Mission Statements

Pushback against Principles as the Basis for Change Efforts and as the Evaluand

Evaluators, Values, and Valuing

Values and Evaluators: Neutrality or Advocacy?

The Heart of Inspiration

16. Principles‑Focused Evaluation at the Grassroots in Africa: Inspirational Examples and Reflections

Principles in Support of "Walking the Talk"

The Alliance for Food Sovereignty in Africa

Permaculture Research Institute-Kenya Principles

Context‑Specific Principles

STIPA

Personal Reflections on Principles‑Focused Evaluation

17. Inspiring Principles: Distinguishing Overarching Principles from Operational Principles

ChildFund International

Inspiration

Principles Emerge

18. Principles‑Focused Pedagogy of Evaluation

Freirean Principles

Freire's Engagement Process

Extrapolation of Freirean Principles

A Holistic Freirean Evaluation Framework

Principles‑Focused Evaluation of Freirean Pedagogy

Matching the Evaluation Approach to the Nature of the Initiatives Being Evaluated

D. Developmental

19. The Developmental Nature of Effectiveness Principles

The Intersection of Engagement and Developmental Evaluation

Ongoing Development

20. Simple Rules and Minimum Specifications

Simple Rules

The Good, the Bad, and the Confusing

Minimum Specifications

Weaving Together Principles and MIN SPEC Practices

E. Evaluable

21. Evaluable Principles

Evaluating the Meaningfulness and Quality of Principles Using the GUIDE Criteria

Evaluating Adherence to Principles

Qualitative Coding of Principles.

Rigorous Research on and Evaluation of Principles

Summary and Conclusion

22. Principles‑Focused Sampling

Project SPIRIT

Purposeful Principles‑Focused Evaluation Sampling

Diverse Principles‑Focused Sampling Examples

Summary

23. Rendering Judgments about the Effectiveness of Principles

Evaluative Reasoning

Warranted Conclusions and Credible Judgments

Rigorous Thinking

Telling the Summative Story through Principles-Focused Contribution Analysis

Contribution Analysis Conclusions about Effectiveness Principles

Making Credible Summative Judgments about the Effectiveness of Principles

24. Evaluating Principles for Evidence of Effectiveness

Effective Principles in Contrast to Best Practices

Why This Matters

Summary of Parts I and II

Synthesis of Themes for Principles‑Focused Evaluation

Principles Rule

Part III. Principles‑Driven Initiatives with Principles‑Focused Evaluations

Part IIIA. Three Levels of Principles-Based Interventions

25. Principles Driving Reform

The Paris Declaration on Aid Effectiveness

Evaluation Results

Significance and Quality of the Paris Declaration Evaluation

Evaluation Focus, Design, and Methods

The Evaluation Findings

Methodological Approach and Quality

Principles‑Focused Evaluation Process Use

Evaluation Financing and Resources

Lessons from the Paris Declaration Evaluation

Concluding Reflections

26. Discovering and Validating Effectiveness Principles to Help Youth Overcome Homelessness

It Begins with Committed and Principled People

Principles-Focused Evaluation Design and Results

Excerpt from the Report

Outcomes Snapshots

Chapter Review

Lessons from the Youth Homelessness Collaborative Experience.

Concluding Reflections

27. Vibrant Communities Canada

A Principles‑Driven Community Change Initiative

The Evaluation

Evaluation Redesign

Evaluating VC

Elaborating on VC Principles in Practice

Lessons from the VC Experience

Part IIIB. Three Different Agriculture-Focused Initiatives

28. Collaborative Principles Supporting Shared Commitment

The Global Alliance for the Future of Food

Application and Implication of the Principles

Lessons from the Global Alliance Experience

29. Principles Enhancing Coherence

Diversity, Complexity, and Contextual Variation

Creating an Integrated Monitoring, Evaluation, and Planning Process

Two Levels of Principles

Process for Developing the Principles

Caveats

Lessons from the Collaborative Crop Research Program

30. Principles Defining the Emergent Field of Agroecology

The Emergence of Agroecology as an Applied Discipline Based on Principles

Tracing the History

Principles of Agroecology

Comprehensive Approach to Agroecology

Agroecological Principles in the CCRP

Principles of Agroecology as an Organizing Heuristic for the Agroecology Knowledge Hub

The Role of Evaluating Principles in Defining a Field

Lessons from Agroecology

Part IV. Principles for Evaluations and Evaluators

31. Evaluating Evaluation Principles

Examples of Evaluation Principles

AEA Guiding Principles

Design Principles for Data Visualization in Evaluation

Principles for Culturally Competent Evaluation Practice

Principles of Evaluative Thinking

Principles for Guiding Collaborative Approaches to Evaluation

Methodological Principles

Evaluating Evaluation Principles

32. Outcome Harvesting Evaluation.

Outcome Harvesting Evaluation.

Notes:

Includes bibliographical references at the end of each chapters and index.

Description based on print version record.

Description based on publisher supplied metadata and other sources.

OCLC:

1003488902