Realworld Evaluation

This book helps practicing evaluators design and conduct competent evaluation studies, while explicitly considering resource and data constraints. The book is organized around a seven-step model developed by the authors, and which has been tested and refined in workshops that cater to a broad spectrum of evaluation practitioners. Vignettes from practice and case studies, representing evaluations from a variety of geographic regions and sectors, demonstrate adaptive possibilities for small projects with budgets of a few thousand dollars, or timelines as brief as a few days, to large-scale, long-term evaluations with multi-million-dollar budgets. The text is specifically designed to incorporate quantitative, qualitative, and mixed-method designs.

RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints addresses the challenges of conducting program evaluations in real-world contexts where evaluators and their clients face budget and time constraints. The book is organized around the authors’ seven-step model that has been tested in workshops and practice environments to help the evaluation implementers and managers make the best choices when faced with real world constraints. The Third Edition includes a new chapter on gender equality and women’s empowerment and discussion of digital technology and data science.

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

Is your program ready for the real world? Real world evaluation is a balance between art, science, accuracy, and cost. To set your program up for success, you need to start the measurement and evaluation journey with a clear destination in mind. In Real World Training Evaluation, Patricia and Jack Phillips hone in on ROI in learning and development and outline a clear pathway to seamless and credible evaluation. Learn to avoid real world barriers that commonly get in the way of talent development initiatives. Earn the respect of senior management by showing bottom-line impact, including the ROI. And start describing program successes in quantitative, qualitative, financial, and non-financial terms to win over crucial stakeholders. By demonstrating program results, you can help your organization link its human capital investment to operational excellence and sustainability. Real World Training Evaluation offers the directions and tools to get you there.

Evaluation research findings should be a key element of the policy-making process, yet in reality they are often disregarded. This valuable book examines the development of evaluation and its impact on public policy by analysing evaluation frameworks and criteria which are available when evaluating public policies and services. It further examines the nature of evidence and its use and non-use by decision-makers and assesses the work of influential academics in the USA and UK in the context of evaluation and policy making. The book emphasises the 'real world' of decision-makers in the public sector and recognises how political demands and economic pressures can affect the decisions of those who commission evaluation research while providing recommendations for policymakers on adopting a different approach to evaluation. This is essential reading for under-graduate and post-graduate students of policy analysis and public sector management, and those who are involved in the planning and evaluation of public policies and services.

Real-world evidence (RWE) has been at the forefront of pharmaceutical innovations. It plays an important role in transforming drug development from a process aimed at meeting regulatory expectations to an operating model that leverages data from disparate sources to aid business, regulatory, and healthcare decision making. Despite its many benefits, there is no single book systematically covering the latest development in the field. Written specifically for pharmaceutical practitioners, Real-World Evidence in Drug Development and Evaluation, presents a wide range of RWE applications throughout the lifecycle of drug product development. With contributions from experienced researchers in the pharmaceutical industry, the book discusses at length RWE opportunities, challenges, and solutions. Features Provides the first book and a single source of information on RWE in drug development Covers a broad array of topics on outcomes- and value-based RWE assessments Demonstrates proper Bayesian application and causal inference for real-world data (RWD) Presents real-world use cases to illustrate the use of advanced analytics and statistical methods to generate insights Offers a balanced discussion of practical RWE issues at hand and technical solutions suitable for practitioners with limited data science expertise

Demystifying the evaluation journey, this is the first evaluation mentoring book that addresses the choices, roles, and challenges that evaluators must navigate in the real world. Experienced evaluator and trainer Donna R. Podems covers both conceptual and technical aspects of practice in a friendly, conversational style. She focuses not just on how to do evaluations but how to think like an evaluator, fostering reflective, ethical, and culturally sensitive practice. Extensive case examples illustrate the process of conceptualizing and implementing an evaluation--clarifying interventions, identifying beneficiaries, gathering data, discussing results, valuing, and developing recommendations. The differences (and connections) between research, evaluation, and monitoring are explored. Handy icons identify instructive features including self-study exercises, group activities, clarifying questions, facilitation and negotiation techniques, insider tips, advice, and resources. Purchasers can access a companion website to download and print reproducible materials for some of the activities and games described in the book.

Evaluation research findings should be a key element of the policy-making process, yet in reality they are often disregarded. This valuable book examines the development of evaluation and its impact on public policy by analysing evaluation frameworks and criteria which are available when evaluating public policies and services. It further examines the nature of evidence and its use and non-use by decision-makers and assesses the work of influential academics in the USA and UK in the context of evaluation and policy making. The book emphasises the 'real world' of decision-makers in the public sector and recognises how political demands and economic pressures can affect the decisions of those who commission evaluation research while providing recommendations for policymakers on adopting a different approach to evaluation. This is essential reading for under-graduate and post-graduate students of policy analysis and public sector management, and those who are involved in the planning and evaluation of public policies and services.

Recognizing that complexity calls for innovative, conceptual, and methodological solutions, Dealing with Complexity in Development Evaluation by Michael Bamberger, Jos Vaessen, and Estelle Raimondo offers practical guidance to policymakers, managers, and evaluation practitioners on how to design and implement complexity-responsive evaluations that can be undertaken in the real world of time, budget, data, and political constraints. Introductory chapters present comprehensive, non-technical overviews of the most common evaluation tools and methodologies, and additional content addresses more cutting-edge material. The book also includes six case study chapters to illustrate examples of various evaluation contexts from around the world.

Evaluation Methodology Basics introduces evaluation by focusing on the main kinds of 'big picture' questions that evaluations usually need to answer, and how the nature of such questions are linked to evaluation methodology choices. The author: shows how to identify the right criteria for your evaluation; discusses how to objectively figure out which criteria are more important than the others; and, delves into how to combine a mix of qualitative and quantitative data with 'relevant values' (such as needs) to draw explicitly evaluative conclusions.