Vision Based Mobile Robot Navigation

This monograph is devoted to the theory and development of autonomous navigation of mobile robots using computer vision based sensing mechanism. The conventional robot navigation systems, utilizing traditional sensors like ultrasonic, IR, GPS, laser sensors etc., suffer several drawbacks related to either the physical limitations of the sensor or incur high cost. Vision sensing has emerged as a popular alternative where cameras can be used to reduce the overall cost, maintaining high degree of intelligence, flexibility and robustness. This book includes a detailed description of several new approaches for real life vision based autonomous navigation algorithms and SLAM. It presents the concept of how subgoal based goal-driven navigation can be carried out using vision sensing. The development concept of vision based robots for path/line tracking using fuzzy logic is presented, as well as how a low-cost robot can be indigenously developed in the laboratory with microcontroller based sensor systems. The book describes successful implementation of integration of low-cost, external peripherals, with off-the-shelf procured robots. An important highlight of the book is that it presents a detailed, step-by-step sample demonstration of how vision-based navigation modules can be actually implemented in real life, under 32-bit Windows environment. The book also discusses the concept of implementing vision based SLAM employing a two camera based system.

The book includes topics, such as: path planning, avoiding obstacles, following the path, go-to-goal control, localization, and visual-based motion control. The theoretical concepts are illustrated with a developed control architecture with soft computing and artificial intelligence methods. The proposed vision-based motion control strategy involves three stages. The first stage consists of the overhead camera calibration and the configuration of the working environment. The second stage consists of a path planning strategy using several traditional path planning algorithms and proposed planning algorithm. The third stage consists of the path tracking process using previously developed Gauss and Decision Tree control approaches and the proposed Type-1 and Type-2 controllers. Two kinematic structures are utilized to acquire the input values of controllers. These are Triangle Shape-Based Controller Design, which was previously developed and Distance-Based Triangle Structure that is used for the first time in conducted experiments. Four different control algorithms, Type-1 fuzzy logic, Type-2 Fuzzy Logic, Decision Tree Control, and Gaussian Control have been used in overall system design. The developed system includes several modules that simplify characterizing the motion control of the robot and ensure that it maintains a safe distance without colliding with any obstacles on the way to the target. The topics of the book are extremely relevant in many areas of research, as well as in education in courses in computer science, electrical and mechanical engineering and in mathematics at the graduate and undergraduate levels.

Visual informatics is a field of interest not just among the information technology and computer science community, but also other related fields such as engineering, me- cal and health informatics and education starting in the early 1990s. Recently, the field is gaining more attention from researchers and industry. It has become a mul- disciplinary and trans-disciplinary field related to research areas such as computer vision, visualization, information visualization, real-time image processing, medical image processing, image information retrieval, virtual reality, augmented reality, - pressive visual mathematics, 3D graphics, multimedia-fusion, visual data mining, visual ontology, as well as services and visual culture. Various efforts has been - vested in different research, but operationally, many of these systems are not pro- nent in the mass market and thus knowledge and research on these phenomena within the mentioned areas need to be shared and disseminated. It is for this reason that the Visual Informatics Research Group from Universiti - bangsaan Malaysia (UKM) decided to spearhead this initiative to bring together experts in this very diversified but important research area so that more concerted efforts can be undertaken not just within the visual informatics community in Malaysia but from other parts of the world, namely, Asia, Europe, Oceania, and USA. This first International Visual Informatics Conference (IVIC 2009) was conducted collaboratively, by the visual informatics research community from the various public and private institutions of higher learning in Malaysia, and hosted by UKM.

This study addresses the issue of vision based mobile robot navigation in a partially cluttered indoor environment using a mapless navigation strategy. The work focuses on two key problems, namely vision based obstacle avoidance and vision based reactive navigation strategy. The estimation of optical flow plays a key role in vision based obstacle avoidance problems, however the current view is that this technique is too sensitive to noise and distortion under real conditions. Accordingly, practical applications in real time robotics remain scarce. This dissertation presents a novel methodology for vision based obstacle avoidance, using a hybrid architecture. This integrates an appearance-based obstacle detection method into an optical flow architecture based upon a behavioural control strategy that includes a new arbitration module. This enhances the overall performance of conventional optical flow based navigation systems, enabling a robot to successfully move around without experiencing collisions. Behaviour based approaches have become the dominant methodologies for designing control strategies for robot navigation. Two different behaviour based navigation architectures have been proposed for the second problem, using monocular vision as the primary sensor and equipped with a 2-D range finder. Both utilize an accelerated version of the Scale Invariant Feature Transform (SIFT) algorithm. The first architecture employs a qualitative-based control algorithm to steer the robot towards a goal whilst avoiding obstacles, whereas the second employs an intelligent control framework. This allows the components of soft computing to be integrated into the proposed SIFT-based navigation architecture, conserving the same set of behaviours and system structure of the previously defined architecture. The intelligent framework incorporates a novel distance estimation technique using the scale parameters obtained from the SIFT algorithm. The technique employs scale parameters and a corresponding zooming factor as inputs to train a neural network which results in the determination of physical distance. Furthermore a fuzzy controller is designed and integrated into this framework so as to estimate linear velocity, and a neural network based solution is adopted to estimate the steering direction of the robot. As a result, this intelligent iv approach allows the robot to successfully complete its task in a smooth and robust manner without experiencing collision. MS Robotics Studio software was used to simulate the systems, and a modified Pioneer 3-DX mobile robot was used for real-time implementation. Several realistic scenarios were developed and comprehensive experiments conducted to evaluate the performance of the proposed navigation systems. KEY WORDS: Mobile robot navigation using vision, Mapless navigation, Mobile robot architecture, Distance estimation, Vision for obstacle avoidance, Scale Invariant Feature Transforms, Intelligent framework.

The use of vision in mobile robotics in one of the main goal of this thesis. In particular novel appearance based approaches for image matching metric are introduced. These approaches are applied to the problem of mobile robot localization.Similarity measures between robot's views are used in probabilistic methods for robot pose estimation. In this field of probabilistic localization active approach are proposed allowing the robot to faster and better localize. All methods have been extensively tested using a real robot in an indoor environment.Note: the book is the publication of the PhD thesis discussed in Università Politecnica delle Marche, Ancona, Italy in 2006 by Emanuele Frontoni

Introduction to Mobile Robot Control provides a complete and concise study of modeling, control, and navigation methods for wheeled non-holonomic and omnidirectional mobile robots and manipulators. The book begins with a study of mobile robot drives and corresponding kinematic and dynamic models, and discusses the sensors used in mobile robotics. It then examines a variety of model-based, model-free, and vision-based controllers with unified proof of their stabilization and tracking performance, also addressing the problems of path, motion, and task planning, along with localization and mapping topics. The book provides a host of experimental results, a conceptual overview of systemic and software mobile robot control architectures, and a tour of the use of wheeled mobile robots and manipulators in industry and society. Introduction to Mobile Robot Control is an essential reference, and is also a textbook suitable as a supplement for many university robotics courses. It is accessible to all and can be used as a reference for professionals and researchers in the mobile robotics field. Clearly and authoritatively presents mobile robot concepts Richly illustrated throughout with figures and examples Key concepts demonstrated with a host of experimental and simulation examples No prior knowledge of the subject is required; each chapter commences with an introduction and background

Many robotics researchers consider high-level vision algorithms (computational) too expensive for use in robot guidance. This book introduces the reader to an alternative approach to perception for autonomous, mobile robots. It explores how to apply methods of high-level computer vision and fuzzy logic to the guidance and control of the mobile robot. The book introduces a knowledge-based approach to vision modeling for robot guidance, where advantage is taken of constraints of the robot's physical structure, the tasks it performs, and the environments it works in. This facilitates high-level computer vision algorithms such as object recognition at a speed that is sufficient for real-time navigation. The texts presents algorithms that exploit these constraints at all levels of vision, from image processing to model construction and matching, as well as shape recovery. These algorithms are demonstrated in the navigation of a wheeled mobile robot.

This monograph is a revised version of the D.Phil. thesis of the first author, submitted in October 1990 to the University of Oxford. This work investigates the problem of mobile robot navigation using sonar. We view model-based navigation as a process of tracking naturally occurring environment features, which we refer to as "targets". Targets that have been predicted from the environment map are tracked to provide that are observed, but not predicted, vehicle position estimates. Targets represent unknown environment features or obstacles, and cause new tracks to be initiated, classified, and ultimately integrated into the map. Chapter 1 presents a brief definition of the problem and a discussion of the basic research issues involved. No attempt is made to survey ex haustively the mobile robot navigation literature-the reader is strongly encouraged to consult other sources. The recent collection edited by Cox and Wilfong [34] is an excellent starting point, as it contains many of the standard works of the field. Also, we assume familiarity with the Kalman filter. There are many well-known texts on the subject; our notation derives from Bar-Shalom and Fortmann [7]. Chapter 2 provides a detailed sonar sensor model. A good sensor model of our approach to navigation, and is used both for is a crucial component predicting expected observations and classifying unexpected observations.

The presence of mobile robots in diverse scenarios is considerably increasing to perform a variety of tasks. Among them, many developments have occurred in the fields of ground, underwater, and flying robotics. Independent of the environment where they move, navigation is a fundamental ability of mobile robots so that they can autonomously complete high-level tasks. This problem can be efficiently addressed through the following actions: First, it is necessary to perceive the environment in which the robot has to move, and extract some relevant information (mapping problem). Second, the robot must be able to estimate its position and orientation within this environment (localization problem). With this information, a trajectory toward the target points must be planned (path planning), and the vehicle must be reactively guided along this trajectory considering either possible changes or interactions with the environment or with the user (control). Given this information, this book introduces current frameworks in these fields (mapping, localization, path planning, and control) and, in general, approaches to any problem related to the navigation of mobile robots, such as odometry, exploration, obstacle avoidance, and simulation.

This pioneering book describes the development of a robot mapping and navigation system inspired by models of the neural mechanisms underlying spatial navigation in the rodent hippocampus. Computational models of animal navigation systems have traditionally had limited performance when implemented on robots. This is the first research to test existing models of rodent spatial mapping and navigation on robots in large, challenging, real world environments.