Impact Analysis For Program Evaluation

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

Mohr covers impact analysis, a tool of programme evaluation to estimate the difference between observed programme results and the results that would have occurred in the absence of the programme. He offers coverage of systematic ways to find the proper goals to use in single and multiple outcome evaluations. Some knowledge of regression analysis is assumed.

Public programs are designed to reach certain goals and beneficiaries. Methods to understand whether such programs actually work, as well as the level and nature of impacts on intended beneficiaries, are main themes of this book.

The First Edition of this useful book was popular for its integration of multiple regression with evaluation design and for offering systematic ways to select the proper goals for single- and multiple-outcome evaluations. This revised edition covers new issues and to clarify further the concepts used in impact analysis.

Through the use of specific examples to illustrate evaluation research goals and methods, this book provides readers with an overview of the science and politics of evaluation research. The Second Edition includes coverage of meta-analysis, selection models and instrumental variables.

Evaluation is a controversial and little-understood strategy of public governance, control, and decision making. As early as classical antiquity, scholars were summoned to court to counsel kings. Public policy and program evaluation is a recent addition to the great chain of attempts to use the brainpower of scholars and scientists to further the interests of the state. Evaluation scholars are asked to provide retrospective assessments of the implementation, output, and outcome of government measures in order to effect deeper understanding and well-grounded decisions on the part of those in charge of government operations. Evaluation is the process of distinguishing the worthwhile from the worthless, the precious from the useless; evaluation implies looking backward in order to be able to steer forward better. Written from a political science perspective, Public Policy and Program Evaluation provides an overview of the possibilities and limits of public sector evaluation. Evert Vedung examines evaluation as a mechanism for monitoring, systematizing, and grading government activities and their results so that public officials, in their future-oriented work, will be able to act as responsibly, creatively, and efficiently as possible. Topics discussed include: "Evaluation, Rationality, and Theories of Public Management"; "Models of Evaluation"; "Internal or External Evaluation"; "Impact Assessment as Tryout and Social Experimentation"; "Process Evaluation and Implementation Theory"; "The Eight-Problems Approach to Evaluation"; and "Uses and Users of Evaluation." All evaluation rests upon the idea that perceptions, opinions, intentions, judgments—in short, everything concerned with the world of human consciousness—play such interesting roles in political and administrative action that their functions are worth investigating. Through experience, humans may learn from past actions. The interventions of the modern state are so extensive, their execu

The social sector provides services to a wide range of people throughout the world with the aim of creating social value. While doing good is great, doing it well is even better. These organizations, whether nonprofit, for-profit, or public, increasingly need to demonstrate that their efforts are making a positive impact on the world, especially as competition for funding and other scarce resources increases. This heightened focus on impact is positive: learning whether we are making a difference enhances our ability to address pressing social problems effectively and is critical to wise stewardship of resources. Yet demonstrating efficacy remains a big hurdle for most organizations. The Goldilocks Challenge provides a parsimonious framework for measuring the strategies and impact of social sector organizations. A good data strategy starts first with a sound theory of change that helps organizations decide what elements they should monitor and measure. With a theory of change providing solid underpinning, the Goldilocks framework then puts forward four key principles, the CART principles: Credible data that are high quality and analyzed appropriately, Actionable data will actually influence future decisions; Responsible data create more benefits than costs; and Transportable data build knowledge that can be used in the future and by others. Mary Kay Gugerty and Dean Karlan combine their extensive experience working with nonprofits, for-profits and government with their understanding of measuring effectiveness in this insightful guide to thinking about and implementing evidence-based change. This book is an invaluable asset for nonprofit, social enterprise and government leaders, managers, and funders-including anyone considering making a charitable contribution to a nonprofit-to ensure that these organizations get it "just right" by knowing what data to collect, how to collect it, how it can be analyzed, and drawing implications from the analysis. Everyone who wants to make positive change should focus on the top priority: using data to learn, innovate, and improve program implementation over time. Gugerty and Karlan show how.

Impact evaluation is an empirical approach to estimating the causal effects of interventions, in terms of both magnitude and statistical significance. Expanded use of impact evaluation techniques is critical to rigorously derive knowledge from development operations and for development investments and policies to become more evidence-based and effective. To help backstop more use of impact evaluation approaches, this book introduces core concepts, methods, and considerations for planning, designing, managing, and implementing impact evaluation, supplemented by examples. The topics covered range from impact evaluation purposes to basic principles, specific methodologies, and guidance on field implementation. It has materials for a range of audiences, from those who are interested in understanding evidence on "what works" in development, to those who will contribute to expanding the evidence base as applied researchers.

This book provides a non-technical introduction to the fundamental principles and techniques of regional impact and evaluation analysis. The book is written for readers who have a minimal background in mathematics and economics and so the materials listed in the bibliographies have been chosen for their accessibility to such readers. References to relevant papers of a more technical nature are indicated in notes in each reference.Unlike existing texts, which usually concentrate on regional impact or evaluation analysis, Regional Economic Impact Analysis and Project Evaluation offers an extensive introduction to both these subjects, since both are critical to the study and practice of regional economic analysis.Two case studies, intended as illustrations of practical applications, are included in each of the six chapters that deal with specific principles or techniques. While many of the case studies and much of the literature cited in the bibliographies is Canadian, a substantial portion is from the United States and Great Britain, demonstrating that the principles and techniques discussed in this book are universally applicable.