Evaluating Information Systems

The adoption of Information Technology (IT) and Information Systems (IS) represents significant financial investments, with alternative perspectives to the evaluation domain coming from both the public and private sectors. As a result of increasing IT/IS budgets and their growing significance within the development of an organizational infrastructure, the evaluation and performance measurement of new technology remains a perennial issue for management. This book offers a refreshing and updated insight into the social fabric and technical dimensions of IT/IS evaluation together with insights into approaches used to measure the impact of information systems on its stakeholders. In doing so, it describes the portfolio of appraisal techniques that support the justification of IT/IS investments. Evaluating Information Systems explores the concept of evaluation as an evolutionary and dynamic process that takes into account the ability of enterprise technologies to integrate information systems within and between organisations. In particular, when set against a backdrop of organisational learning. It examines the changing portfolio of benefits, costs and risks associated with the adoption and diffusion of technology in today's global marketplace. Finally approaches to impact assessment through performance management and benchmarking is discussed.

Innovative 2nd edition, heavily updated and revised from the 1st edition Introduction to various survey and evaluation methods involving IT systems in the healthcare setting Critical overview of current research in health and social sciences Emphasizes multi-method approach to system evaluation Includes instruments suitable for research and evaluation Discusses computer programs for data analysis and evaluation resources Essential reference for anyone involved in planning, developing, implementing, utilizing, evaluating, or studying computer-based health care systems

This practical guide draws on extensive empirical studies in health care computing and provides the reader with the tools to evaluate the impact of information systems on a wide variety of health-care organizations.

This open access book summarizes the first two decades of the NII Testbeds and Community for Information access Research (NTCIR). NTCIR is a series of evaluation forums run by a global team of researchers and hosted by the National Institute of Informatics (NII), Japan. The book is unique in that it discusses not just what was done at NTCIR, but also how it was done and the impact it has achieved. For example, in some chapters the reader sees the early seeds of what eventually grew to be the search engines that provide access to content on the World Wide Web, todays smartphones that can tailor what they show to the needs of their owners, and the smart speakers that enrich our lives at home and on the move. We also get glimpses into how new search engines can be built for mathematical formulae, or for the digital record of a lived human life. Key to the success of the NTCIR endeavor was early recognition that information access research is an empirical discipline and that evaluation therefore lay at the core of the enterprise. Evaluation is thus at the heart of each chapter in this book. They show, for example, how the recognition that some documents are more important than others has shaped thinking about evaluation design. The thirty-three contributors to this volume speak for the many hundreds of researchers from dozens of countries around the world who together shaped NTCIR as organizers and participants. This book is suitable for researchers, practitioners, and students--anyone who wants to learn about past and present evaluation efforts in information retrieval, information access, and natural language processing, as well as those who want to participate in an evaluation task or even to design and organize one.

Provides an overview and instruction on the evaluation of interactive information retrieval systems with users.

The adoption of Information Technology (IT) and Information Systems (IS) represents significant financial investments, with alternative perspectives to the evaluation domain coming from both the public and private sectors. As a result of increasing IT/IS budgets and their growing significance within the development of an organizational infrastructure, the evaluation and performance measurement of new technology remains a perennial issue for management. This book offers a refreshing and updated insight into the social fabric and technical dimensions of IT/IS evaluation together with insights into approaches used to measure the impact of information systems on its stakeholders. In doing so, it describes the portfolio of appraisal techniques that support the justification of IT/IS investments. Evaluating Information Systems explores the concept of evaluation as an evolutionary and dynamic process that takes into account the ability of enterprise technologies to integrate information systems within and between organisations. In particular, when set against a backdrop of organisational learning. It examines the changing portfolio of benefits, costs and risks associated with the adoption and diffusion of technology in today's global marketplace. Finally approaches to impact assessment through performance management and benchmarking is discussed.

Why do enterprise systems have complicated search pages, when Google has a single search box that works better? Why struggle with an expense reimbursement system that is not as easy as home accounting software? Although this seems like comparing apples to oranges, as information and communication technologies increasingly reach into every industry

In this book the authors introduce and explain many methods and models for the development of Information Systems (IS). It was written in large part to aid designers in designing successful devices/systems to match user needs in the field. Chief among these are website development, usability evaluation, quality evaluation and success assessment. The book provides great detail in order to assist readers’ comprehension and understanding of both novel and refined methodologies by presenting, describing, explaining and illustrating their basics and working mechanics. Furthermore, this book presents many traditional methods and methodologies in an effort to make up a comprehensive volume on High Level Models and Methodologies for Information Systems. The target audience for this book is anyone interested in conducting research in IS planning and development. The book represents a main source of theory and practice of IS methods and methodologies applied to these realities. The book will appeal to a range of professions that are involved in planning and building the information systems, for example information technologists, information systems developers, as well as Web designers and developers—both researchers and practitioners; as a consequence, this book represents a genuinely multi-disciplinary approach to the field of IS methods and methodologies.

A unifying foundation to design and implement process-aware information systems This publication takes on the formidable task of establishing a unifying foundation and set of common underlying principles to effectively model, design, and implement process-aware information systems. Authored by leading authorities and pioneers in the field, Process-Aware Information Systems helps readers gain a thorough understanding of major concepts, languages, and techniques for building process-aware applications, including: * UML and EPCs: two of the most widely used notations for business process modeling * Concrete techniques for process design and analysis * Process execution standards: WfMC and BPEL * Representative commercial tools: ARIS, TIBCO Staffware, and FLOWer Each chapter begins with a description of the problem domain and then progressively unveils relevant concepts and techniques. Examples and illustrations are used extensively to clarify and simplify complex material. Each chapter ends with a set of exercises, ranging from simple questions to thought-provoking assignments. Sample solutions for many of the exercises are available on the companion Web site. Armed with a new and deeper understanding, readers are better positioned to make their own contributions to the field and evaluate various approaches to a particular task or problem. This publication is recommended as a textbook for graduate and advanced undergraduate students in computer science and information systems, as well as for professionals involved in workflow and business process management, groupware and teamwork, enterprise application integration, and business-to-business integration. A Solution's Manual is available online. An Instructor Support FTP site is also available.

Information Systems Success Measurement presents a comprehensive review of the foundations, the trends, and the future challenges of IS success measurement in order to improve research and practice in terms of the measurement and evaluation of information systems. Information Systems Success Measurement explores the foundations and trends in the definition and measurement of information systems success. Starting with an introduction that examines how the concept of "effective" or "successful" information systems has progressed as information technology and its use has changed over the past 60 years. The authors introduce the DeLone and McLean Information Systems Success Model as an organizing framework for this monograph. Section 2 identifies five eras of information systems and for each of these eras the authors consider the types of information systems used in firms, the stakeholders impacted by these systems, the relevant research about information systems evaluation, and the measurement of IS success in practice during each of these periods. Section 3 discusses the foundational research on IS success measurement. Based on the evolution of the field's understanding of IS success, important trends in IS success measurement is highlighted in Section 4. Section 5 examines the future of IS success research. Section 6 reviews empirical findings related to success factors, which influence IS success. Section 7 explores how managers can improve the methods they use to measure and track IS success. Finally, the authors offer concluding remarks in Section 8.