Running Randomized Evaluations

A comprehensive guide to running randomized impact evaluations of social programs in developing countries This book provides a comprehensive yet accessible guide to running randomized impact evaluations of social programs. Drawing on the experience of researchers at the Abdul Latif Jameel Poverty Action Lab, which has run hundreds of such evaluations in dozens of countries throughout the world, it offers practical insights on how to use this powerful technique, especially in resource-poor environments. This step-by-step guide explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities. It shows how to design and analyze studies that answer important questions while respecting the constraints of those working on and benefiting from the program being evaluated. The book gives concrete tips on issues such as improving the quality of a study despite tight budget constraints, and demonstrates how the results of randomized impact evaluations can inform policy. With its self-contained modules, this one-of-a-kind guide is easy to navigate. It also includes invaluable references and a checklist of the common pitfalls to avoid. Provides the most up-to-date guide to running randomized evaluations of social programs, especially in developing countries Offers practical tips on how to complete high-quality studies in even the most challenging environments Self-contained modules allow for easy reference and flexible teaching and learning Comprehensive yet nontechnical

A comprehensive guide to running randomized impact evaluations of social programs in developing countries This book provides a comprehensive yet accessible guide to running randomized impact evaluations of social programs. Drawing on the experience of researchers at the Abdul Latif Jameel Poverty Action Lab, which has run hundreds of such evaluations in dozens of countries throughout the world, it offers practical insights on how to use this powerful technique, especially in resource-poor environments. This step-by-step guide explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities. It shows how to design and analyze studies that answer important questions while respecting the constraints of those working on and benefiting from the program being evaluated. The book gives concrete tips on issues such as improving the quality of a study despite tight budget constraints, and demonstrates how the results of randomized impact evaluations can inform policy. With its self-contained modules, this one-of-a-kind guide is easy to navigate. It also includes invaluable references and a checklist of the common pitfalls to avoid. Provides the most up-to-date guide to running randomized evaluations of social programs, especially in developing countries Offers practical tips on how to complete high-quality studies in even the most challenging environments Self-contained modules allow for easy reference and flexible teaching and learning Comprehensive yet nontechnical

A comprehensive guide to running randomized impact evaluations of social programs in developing countries This book provides a comprehensive yet accessible guide to running randomized impact evaluations of social programs. Drawing on the experience of researchers at the Abdul Latif Jameel Poverty Action Lab, which has run hundreds of such evaluations in dozens of countries throughout the world, it offers practical insights on how to use this powerful technique, especially in resource-poor environments. This step-by-step guide explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities. It shows how to design and analyze studies that answer important questions while respecting the constraints of those working on and benefiting from the program being evaluated. The book gives concrete tips on issues such as improving the quality of a study despite tight budget constraints, and demonstrates how the results of randomized impact evaluations can inform policy. With its self-contained modules, this one-of-a-kind guide is easy to navigate. It also includes invaluable references and a checklist of the common pitfalls to avoid. Provides the most up-to-date guide to running randomized evaluations of social programs, especially in developing countries Offers practical tips on how to complete high-quality studies in even the most challenging environments Self-contained modules allow for easy reference and flexible teaching and learning Comprehensive yet nontechnical

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

A revealing look at the common causes of failures in randomized control experiments during field reseach—and how to avoid them All across the social sciences, from development economics to political science, researchers are going into the field to collect data and learn about the world. Successful randomized controlled trials have brought about enormous gains, but less is learned when projects fail. In Failing in the Field, Dean Karlan and Jacob Appel examine the taboo subject of failure in field research so that researchers might avoid the same pitfalls in future work. Drawing on the experiences of top social scientists working in developing countries, this book describes five common categories of failures, reviews six case studies in detail, and concludes with reflections on best (and worst) practices for designing and running field projects, with an emphasis on randomized controlled trials. Failing in the Field is an invaluable “how-not-to” guide to conducting fieldwork and running randomized controlled trials in development settings.

Impact evaluation is an empirical approach to estimating the causal effects of interventions, in terms of both magnitude and statistical significance. Expanded use of impact evaluation techniques is critical to rigorously derive knowledge from development operations and for development investments and policies to become more evidence-based and effective. To help backstop more use of impact evaluation approaches, this book introduces core concepts, methods, and considerations for planning, designing, managing, and implementing impact evaluation, supplemented by examples. The topics covered range from impact evaluation purposes to basic principles, specific methodologies, and guidance on field implementation. It has materials for a range of audiences, from those who are interested in understanding evidence on "what works" in development, to those who will contribute to expanding the evidence base as applied researchers.

How can evaluation be used most effectively, and what are the strengths and weaknesses of the various methods? Colin Robson provides guidance in a clear and uncluttered way. The issue of collaboration is examined step-by-step; stakeholder models are compared with techniques such as participatory evaluation and practitioner-centred action research; ethical and political considerations are placed in context; and the best ways of communicating findings are discussed. Each chapter is illustrated with helpful exercises to show the practical application of the issues covered, making this an invaluable introduction for anyone new to evaluation.

From Nobel Prize–winning economist Michael Kremer and fellow leading development economist Rachel Glennerster, an innovative solution for providing vaccines in poor countries Millions of people in the third world die from diseases that are rare in the first world—diseases like malaria, tuberculosis, and schistosomiasis. AIDS, which is now usually treated in rich countries, still ravages the world's poor. Vaccines offer the best hope for controlling these diseases and could dramatically improve health in poor countries. But developers have little incentive to undertake the costly and risky research needed to develop vaccines. This is partly because the potential consumers are poor, but also because governments drive down prices. In Strong Medicine, Michael Kremer and Rachel Glennerster offer an innovative yet simple solution to this worldwide problem: "Pull" programs to stimulate research. Here's how such programs would work. Funding agencies would commit to purchase viable vaccines if and when they were developed. This would create the incentives for vaccine developers to produce usable products for these neglected diseases. Private firms, rather than funding agencies, would pick which research strategies to pursue. After purchasing the vaccine, funders could distribute it at little or no cost to the afflicted countries. Strong Medicine details just how these legally binding commitments would work. Ultimately, if no vaccines were developed, such a commitment would cost nothing. But if vaccines were developed, the program would save millions of lives and would be among the world's most cost-effective health interventions.