Field Experiments And Their Critics

In recent years, social scientists have engaged in a deep debate over the methods appropriate to their research. Their long reliance on passive observational collection of information has been challenged by proponents of experimental methods designed to precisely infer causal effects through active intervention in the social world. Some scholars claim that field experiments represent a new gold standard and the best way forward, while others insist that these methods carry inherent inconsistencies, limitations, or ethical dilemmas that observational approaches do not. This unique collection of essays by the most influential figures on every side of this debate reveals its most important stakes and will provide useful guidance to students and scholars in many disciplines.

Field experiments -- randomized controlled trials -- have become ever more popular in political science, as well as in other disciplines, such as economics, social policy and development. Policy-makers have also increasingly used randomization to evaluate public policies, designing trials of tax reminders, welfare policies and international aid programs to name just a few of the interventions tested in this way. Field experiments have become successful because they assess causal claims in ways that other methods of evaluation find hard to emulate. Social scientists and evaluators have rediscovered how to design and analyze field experiments, but they have paid much less attention to the challenges of organizing and managing them. Field experiments pose unique challenges and opportunities for the researcher and evaluator which come from working in the field. The research experience can be challenging and at times hard to predict. This book aims to help researchers and evaluators plan and manage their field experiments so they can avoid common pitfalls. It is also intended to open up discussion about the context and backdrop to trials so that these practical aspects of field experiments are better understood. The book sets out ten steps researchers can use to plan their field experiments, then nine threats to watch out for when they implement them. There are cases studies of voting and political participation, elites, welfare and employment, nudging citizens, and developing countries.

This text provides statistical and biometrical procedures for designing, conducting, analyzing and interpreting field experiments. It addresses the most important research topics in agriculture, including agronomy, breeding and pasture trials; farming systems research; and intercropping research.

The Oxford Handbooks of Political Science are the essential guide to the state of political science today. With engaging contributions from major international scholars The Oxford Handbook of Political Methodology provides the key point of reference for anyone working throughout the discipline.

Everything you were taught about evolution is wrong.

A comprehensive guide to running randomized impact evaluations of social programs in developing countries This book provides a comprehensive yet accessible guide to running randomized impact evaluations of social programs. Drawing on the experience of researchers at the Abdul Latif Jameel Poverty Action Lab, which has run hundreds of such evaluations in dozens of countries throughout the world, it offers practical insights on how to use this powerful technique, especially in resource-poor environments. This step-by-step guide explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities. It shows how to design and analyze studies that answer important questions while respecting the constraints of those working on and benefiting from the program being evaluated. The book gives concrete tips on issues such as improving the quality of a study despite tight budget constraints, and demonstrates how the results of randomized impact evaluations can inform policy. With its self-contained modules, this one-of-a-kind guide is easy to navigate. It also includes invaluable references and a checklist of the common pitfalls to avoid. Provides the most up-to-date guide to running randomized evaluations of social programs, especially in developing countries Offers practical tips on how to complete high-quality studies in even the most challenging environments Self-contained modules allow for easy reference and flexible teaching and learning Comprehensive yet nontechnical

Field experiments -- randomized controlled trials -- have become ever more popular in political science, as well as in other disciplines, such as economics, social policy and development. Policy-makers have also increasingly used randomization to evaluate public policies, designing trials of tax reminders, welfare policies and international aid programs to name just a few of the interventions tested in this way. Field experiments have become successful because they assess causal claims in ways that other methods of evaluation find hard to emulate. Social scientists and evaluators have rediscovered how to design and analyze field experiments, but they have paid much less attention to the challenges of organizing and managing them. Field experiments pose unique challenges and opportunities for the researcher and evaluator which come from working in the field. The research experience can be challenging and at times hard to predict. This book aims to help researchers and evaluators plan and manage their field experiments so they can avoid common pitfalls. It is also intended to open up discussion about the context and backdrop to trials so that these practical aspects of field experiments are better understood. The book sets out ten steps researchers can use to plan their field experiments, then nine threats to watch out for when they implement them. There are cases studies of voting and political participation, elites, welfare and employment, nudging citizens, and developing countries.

A fascinating account of how radical researchers have used experiments to overturn conventional wisdom and shaped life as we know it Experiments have consistently been used in the hard sciences, but in recent decades social scientists have adopted the practice. Randomized trials have been used to design policies to increase educational attainment, lower crime rates, elevate employment rates, and improve living standards among the poor. This book tells the stories of radical researchers who have used experiments to overturn conventional wisdom. From finding the cure for scurvy to discovering what policies really improve literacy rates, Leigh shows how randomistas have shaped life as we know it. Written in a “Gladwell-esque” style, this book provides a fascinating account of key randomized control trial studies from across the globe and the challenges that randomistas have faced in getting their studies accepted and their findings implemented. In telling these stories, Leigh draws out key lessons learned and shows the most effective way to conduct these trials.

In this handbook, internationally renowned scholars outline the current state-of-the-art of quantitative and qualitative market research. They discuss focal approaches to market research and guide students and practitioners in their real-life applications. Aspects covered include topics on data-related issues, methods, and applications. Data-related topics comprise chapters on experimental design, survey research methods, international market research, panel data fusion, and endogeneity. Method-oriented chapters look at a wide variety of data analysis methods relevant for market research, including chapters on regression, structural equation modeling (SEM), conjoint analysis, and text analysis. Application chapters focus on specific topics relevant for market research such as customer satisfaction, customer retention modeling, return on marketing, and return on price promotions. Each chapter is written by an expert in the field. The presentation of the material seeks to improve the intuitive and technical understanding of the methods covered.

For most of political science's history, discussions about professional ethics had nothing to do with human subjects. Professional ethics involved integrity in the classroom, fair tenure and promotion rule, and the careful avoidance of plagiarism. As most research was observational, there was little need for attention to how scholarly activities might directly affect the subjects of our work. Times have changed. The dramatic growth in the use of experiments in social science, especially overseas, is generating unexpected ethical controversies. The purpose of this volume is to identify, debate, and propose practical solutions to the most critical of these new ethical issues. A leading team of internationally distinguished political science scholars presents the first examination of the practical and ethical challenges of research with human subjects in social science and policy studies. Part 1 examines contextual challenges provided by experiments conducted overseas - questions of culture, religion, security, and poverty. Part 2 examines questions of legal constraints on research, focusing on questions of foreign review of international experiments. Part 3 tackles the critical issues in field experiments, including deception and consent, impact on elections and careers, the boundaries of the public officials' exemption, and the use of partner organizations to avoid Institutional Review Body (IRB) review. Part 4 considers strategies for the future, including training and education, IRB reform, institutional changes, and norm development.