Improving Survey Response

For many household surveys in the United States, responses rates have been steadily declining for at least the past two decades. A similar decline in survey response can be observed in all wealthy countries. Efforts to raise response rates have used such strategies as monetary incentives or repeated attempts to contact sample members and obtain completed interviews, but these strategies increase the costs of surveys. This review addresses the core issues regarding survey nonresponse. It considers why response rates are declining and what that means for the accuracy of survey results. These trends are of particular concern for the social science community, which is heavily invested in obtaining information from household surveys. The evidence to date makes it apparent that current trends in nonresponse, if not arrested, threaten to undermine the potential of household surveys to elicit information that assists in understanding social and economic issues. The trends also threaten to weaken the validity of inferences drawn from estimates based on those surveys. High nonresponse rates create the potential or risk for bias in estimates and affect survey design, data collection, estimation, and analysis. The survey community is painfully aware of these trends and has responded aggressively to these threats. The interview modes employed by surveys in the public and private sectors have proliferated as new technologies and methods have emerged and matured. To the traditional trio of mail, telephone, and face-to-face surveys have been added interactive voice response (IVR), audio computer-assisted self-interviewing (ACASI), web surveys, and a number of hybrid methods. Similarly, a growing research agenda has emerged in the past decade or so focused on seeking solutions to various aspects of the problem of survey nonresponse; the potential solutions that have been considered range from better training and deployment of interviewers to more use of incentives, better use of the information collected in the data collection, and increased use of auxiliary information from other sources in survey design and data collection. Nonresponse in Social Science Surveys: A Research Agenda also documents the increased use of information collected in the survey process in nonresponse adjustment.

Questions as Measures An Overview Designing Questions to Gather Factual Data Questions to Measure Subjective States Some General Rules for Designing Good Survey Instruments Presurvey Evaluation of Questions Assessing the Validity of Survey Questions Question Design and Evaluation Issues in Perspective.

High response rates have traditionally been considered as one of the main indicators of survey quality. Obtaining high response rates is sometimes difficult and expensive, but clearly plays a beneficial role in terms of improving data quality. It is becoming increasingly clear, however, that simply boosting response to achieve a higher response rate will not in itself eradicate nonresponse bias. In this book the authors argue that high response rates should not be seen as a goal in themselves, but rather as part of an overall survey quality strategy based on random probability sampling and aimed at minimising nonresponse bias. Key features of Improving Survey Response: A detailed coverage of nonresponse issues, including a unique examination of cross-national survey nonresponse processes and outcomes. A discussion of the potential causes of nonresponse and practical strategies to combat it. A detailed examination of the impact of nonresponse and of techniques for adjusting for it once it has occurred. Examples of best practices and experiments drawn from 25 European countries. Supplemented by the European Social Survey (ESS) websites, containing materials for the measurement and analysis of nonresponse based on detailed country-level response process datasets. The book is designed to help survey researchers and those commissioning surveys by explaining how to prioritise the reduction of nonresponse bias rather than focusing on increasing the overall response rate. It shows substantive researchers how nonresponse can impact on substantive outcomes.

This valuable book examines the complex psychological processes involved in answering different types of survey questions. Drawing on both classic and modern research from cognitive psychology, social psychology, and survey methodology, the authors examine how survey responses are formulated and they demonstrate how seemingly unimportant features of the survey can affect the answers obtained. The book provides a comprehensive review of the sources of response errors in surveys, and it offers a coherent theory of the relation between the underlying views of the public and the results of public opinion polls. Topics include the comprehension of survey questions, the recall of relevant facts and beliefs, estimation and inferential processes people use to answer survey questions, the sources of the apparent instability of public opinion, the difficulties in getting responses into the required format, and the distortions introduced into surveys by deliberate misreporting.

This state-of-the-art volume provides insight into the recent developments in survey research. It covers topics like: survey modes and response effects, bio indicators and paradata, interviewer and survey error, mixed-mode panels, sensitive questions, conducting web surveys and access panels, coping with non-response, and handling missing data. The authors are leading scientists in the field, and discuss the latest methods and challenges with respect to these topics. Each of the book’s eight parts starts with a brief chapter that provides an historical context along with an overview of today’s most critical survey methods. Chapters in the sections focus on research applications in practice and discuss results from field studies. As such, the book will help researchers design surveys according to today’s best practices. The book’s website www.survey-methodology.de provides additional information, statistical analyses, tables and figures. An indispensable reference for practicing researchers and methodologists or any professional who uses surveys in their work, this book also serves as a supplement for graduate or upper level-undergraduate courses on survey methods taught in psychology, sociology, education, economics, and business. Although the book focuses on European findings, all of the research is discussed with reference to the entire survey-methodology area, including the US. As such, the insights in this book will apply to surveys conducted around the world.

To the uninformed, surveys appear to be an easy type of research to design and conduct, but when students and professionals delve deeper, they encounter the vast complexities that the range and practice of survey methods present. To complicate matters, technology has rapidly affected the way surveys can be conducted; today, surveys are conducted via cell phone, the Internet, email, interactive voice response, and other technology-based modes. Thus, students, researchers, and professionals need both a comprehensive understanding of these complexities and a revised set of tools to meet the challenges. In conjunction with top survey researchers around the world and with Nielsen Media Research serving as the corporate sponsor, the Encyclopedia of Survey Research Methods presents state-of-the-art information and methodological examples from the field of survey research. Although there are other "how-to" guides and references texts on survey research, none is as comprehensive as this Encyclopedia, and none presents the material in such a focused and approachable manner. With more than 600 entries, this resource uses a Total Survey Error perspective that considers all aspects of possible survey error from a cost-benefit standpoint. Key Features Covers all major facets of survey research methodology, from selecting the sample design and the sampling frame, designing and pretesting the questionnaire, data collection, and data coding, to the thorny issues surrounding diminishing response rates, confidentiality, privacy, informed consent and other ethical issues, data weighting, and data analyses Presents a Reader′s Guide to organize entries around themes or specific topics and easily guide users to areas of interest Offers cross-referenced terms, a brief listing of Further Readings, and stable Web site URLs following most entries The Encyclopedia of Survey Research Methods is specifically written to appeal to beginning, intermediate, and advanced students, practitioners, researchers, consultants, and consumers of survey-based information.

Internet-based surveys, although still in their infancy, are becoming increasingly popular because they are believed to be faster, better, cheaper and easier to conduct than surveys using traditional methods. This text examines the pros and cons of Internet-based surveys.

In this book, the author considers such issues as how to identify situations most appropriate for a mail survey, how to reduce sampling bias and question response errors, and how to obtain good response rates from a mail survey.