Active Perception In Machine Vision

This book defines the emerging field of Active Perception which calls for studying perception coupled with action. It is devoted to technical problems related to the design and analysis of intelligent systems possessing perception such as the existing biological organisms and the "seeing" machines of the future. Since the appearance of the first technical results on active vision, researchers began to realize that perception -- and intelligence in general -- is not transcendental and disembodied. It is becoming clear that in the effort to build intelligent visual systems, consideration must be given to the fact that perception is intimately related to the physiology of the perceiver and the tasks that it performs. This viewpoint -- known as Purposive, Qualitative, or Animate Vision -- is the natural evolution of the principles of Active Vision. The seven chapters in this volume present various aspects of active perception, ranging from general principles and methodological matters to technical issues related to navigation, manipulation, recognition, learning, planning, reasoning, and topics related to the neurophysiology of intelligent systems.

Intelligent robotics has become the focus of extensive research activity. This effort has been motivated by the wide variety of applications that can benefit from the developments. These applications often involve mobile robots, multiple robots working and interacting in the same work area, and operations in hazardous environments like nuclear power plants. Applications in the consumer and service sectors are also attracting interest. These applications have highlighted the importance of performance, safety, reliability, and fault tolerance. This volume is a selection of papers from a NATO Advanced Study Institute held in July 1989 with a focus on active perception and robot vision. The papers deal with such issues as motion understanding, 3-D data analysis, error minimization, object and environment modeling, object detection and recognition, parallel and real-time vision, and data fusion. The paradigm underlying the papers is that robotic systems require repeated and hierarchical application of the perception-planning-action cycle. The primary focus of the papers is the perception part of the cycle. Issues related to complete implementations are also discussed.

This book addresses an area of perception engineering which deals with constructive processes. A model of the environment is analyzed using the information acquired from mUltiple viewpoints of multiple disparate sensors at multiple time instants. Although the role of successive model building and active exploration of the environment, as is discussed in this book, is of great importance, only a few researchers of machine perception have thus far addressed the problem in these directions. Krotkov's book, which is a modification and continuation of his highly successful dissertation, focuses on active exploratory sensing in the context of spatial layout perception. He uses stereo and focus to obtain distance By information, and to eventually develop cooperative combining techniques. means of a stereo system with verging cameras, it is demonstrated that the distance measurements can be significantly improved by combining two sources. In addition, the problem of merging information from the multiple views is discussed in detail. As the field of perception engineering seems to be of growing scientific and applied importance, both practitioners and researchers in machine perception will find this book a valuable addition to their libraries. RameshJain Series Editor Acknowledgements I would like to thank Professor Ruzena Bajcsy for her constant encouragement and guidance during the five years of research leading to the dissertation upon which this book is based. Without her help in all matters, this work would never have been possible.

Advances in sensing, signal processing, and computer technology during the past half century have stimulated numerous attempts to design general-purpose ma chines that see. These attempts have met with at best modest success and more typically outright failure. The difficulties encountered in building working com puter vision systems based on state-of-the-art techniques came as a surprise. Perhaps the most frustrating aspect of the problem is that machine vision sys tems cannot deal with numerous visual tasks that humans perform rapidly and effortlessly. In reaction to this perceived discrepancy in performance, various researchers (notably Marr, 1982) suggested that the design of machine-vision systems should be based on principles drawn from the study of biological systems. This "neuro morphic" or "anthropomorphic" approach has proven fruitful: the use of pyramid (multiresolution) image representation methods in image compression is one ex ample of a successful application based on principles primarily derived from the study of biological vision systems. It is still the case, however, that the perfor of computer vision systems falls far short of that of the natural systems mance they are intended to mimic, suggesting that it is time to look even more closely at the remaining differences between artificial and biological vision systems.

One of the series in Machine Perception and Artificial Intelligence, this book covers subjects including the Harvard binocular head; heads, eyes, and head-eye systems; a binocular robot head with torsional eye movements; and escape and dodging behaviours for reactive control.

This text features a broad array of research efforts in computer vision including low level processing, perceptual organization, object recognition and active vision. The volume's nine papers specifically report on topics such as sensor confidence, low level feature extraction schemes, non-parametric multi-scale curve smoothing, integration of geometric and non-geometric attributes for object recognition, design criteria for a four degree-of-freedom robot head, a real-time vision system based on control of visual attention and a behavior-based active eye vision system. The scope of the book provides an excellent sample of current concepts, examples and applications from multiple areas of computer vision.

Action is indelibly tied to perception, and good perception is vital to our survival. Action helps to inform organisms about the world they inhabit, and to accrue information that aids in achieving their goals in a timely manner. In many computer vision applications, action plays no role in understanding an image; yet in natural situations, action and perception are inextricably linked across all levels. This thesis is about building machines that operate in real time in the real world, using actions to aid perception. In the chapters of this thesis, there are many examples of active perception domains, each with challenging problems. We analyze these problems mathematically, propose solutions, and evaluate their performance in real world conditions. In the process, we explore a robust mathematical foundation for understanding active perception, and develop many techniques for practical analysis.