Cover Image

Impact evaluation in practice /

Bibliographic Details
Main Author: Gertler, Paul, 1955- (Author)
Corporate Author: EBSCOhost
Format: eBook
Language:English
Published: Washington, DC : International Bank for Reconstruction and Development / The World Bank, [2016]
Edition:Second edition.
Subjects:
Economic development projects > Evaluation.
Evaluation research (Social action programs)
Electronic books.
Online Access:Connect to the full text of this electronic book
Table of Contents:
  • Preface
  • Acknowledgments
  • About the Authors
  • Abbreviations
  • PART ONE. INTRODUCTION TO IMPACT EVALUATION
  • Chapter 1. Why Evaluate?
  • Evidence-Based Policy Making
  • What Is Impact Evaluation?
  • Prospective versus Retrospective Impact Evaluation
  • Efficacy Studies and Effectiveness Studies
  • Complementary Approaches
  • Ethical Considerations Regarding Impact Evaluation
  • Impact Evaluation for Policy Decisions
  • Deciding Whether to Carry Out an Impact Evaluation
  • Chapter 2. Preparing for an Evaluation
  • Initial Steps
  • Constructing a Theory of Change
  • Developing a Results Chain
  • Specifying Evaluation Questions
  • Selecting Outcome and Performance Indicators
  • Checklist: Getting Data for Your Indicators
  • PART TWO. HOW TO EVALUATE
  • Chapter 3. Causal Inference and Counterfactuals
  • Causal Inference
  • The Counterfactual
  • Two Counterfeit Estimates of the Counterfactual
  • Chapter 4. Randomized Assignment
  • Evaluating Programs Based on the Rules of Assignment
  • Randomized Assignment of Treatment
  • Checklist: Randomized Assignment
  • Chapter 5. Instrumental Variables
  • Evaluating Programs When Not Everyone Complies with Their Assignment
  • Types of Impact Estimates
  • Imperfect Compliance
  • Randomized Promotion as an Instrumental Variable
  • Checklist: Randomized Promotion as an Instrumental Variable
  • Chapter 6. Regression Discontinuity Design
  • Evaluating Programs That Use an Eligibility Index
  • Fuzzy Regression Discontinuity Design
  • Checking the Validity of the Regression Discontinuity Design
  • Limitations and Interpretation of the Regression Discontinuity Design Method
  • Checklist: Regression Discontinuity Design
  • Chapter 7. Difference-in-Differences
  • Evaluating a Program When the Rule of Assignment Is Less Clear
  • The Difference-in-Differences Method
  • How Is the Difference-in-Differences Method Helpful?
  • The "Equal Trends" Assumption in Difference-in-Differences
  • Limitations of the Difference-in-Differences Method
  • Checklist: Difference-in-Differences
  • Chapter 8. Matching
  • Constructing an Artifi cial Comparison Group
  • Propensity Score Matching
  • Combining Matching with Other Methods
  • Limitations of the Matching Method
  • Checklist: Matching.
  • Chapter 9. Addressing Methodological Challenges
  • Heterogeneous Treatment Effects
  • Unintended Behavioral Effects
  • Imperfect Compliance
  • Spillovers
  • Attrition
  • Timing and Persistence of Effects
  • Chapter 10. Evaluating Multifaceted Programs
  • Evaluating Programs That Combine Several Treatment Options
  • Evaluating Programs with Varying Treatment Levels
  • Evaluating Multiple Interventions
  • PART THREE. HOW TO IMPLEMENT AN IMPACT EVALUATION
  • Chapter 11. Choosing an Impact Evaluation Method
  • Determining Which Method to Use for a Given Program
  • How a Program's Rules of Operation Can Help Choose an Impact Evaluation Method
  • A Comparison of Impact Evaluation Methods
  • Finding the Smallest Feasible Unit of Intervention
  • Chapter 12. Managing an Impact Evaluation
  • Managing an Evaluation's Team, Time, and Budget
  • Roles and Responsibilities of the Research and Policy Teams
  • Establishing Collaboration
  • How to Time the Evaluation
  • How to Budget for an Evaluation
  • Chapter 13. The Ethics and Science of Impact Evaluation
  • Managing Ethical and Credible Evaluations
  • The Ethics of Running Impact Evaluations
  • Ensuring Reliable and Credible Evaluations through Open Science
  • Checklist: An Ethical and Credible Impact Evaluation
  • Chapter 14. Disseminating Results and Achieving Policy Impact
  • A Solid Evidence Base for Policy
  • Tailoring a Communication Strategy to Different Audiences
  • Disseminating Results
  • PART FOUR. HOW TO GET DATA FOR AN IMPACT EVALUATION
  • Chapter 15. Choosing a Sample
  • Sampling and Power Calculations
  • Drawing a Sample
  • Deciding on the Size of a Sample for Impact Evaluation: Power Calculations
  • Chapter 16. Finding Adequate Sources of Data
  • Kinds of Data That Are Needed
  • Using Existing Quantitative Data
  • Collecting New Survey Data
  • Chapter 17. Conclusion
  • Impact Evaluations: Worthwhile but Complex Exercises
  • Checklist: Core Elements of a Well-Designed Impact Evaluation
  • Checklist: Tips to Mitigate Common Risks in Conducting an Impact Evaluation
  • Glossary.