Stochastic Dynamics Filtering And Optimization

This book introduces essential concepts in stochastic processes that interface seamlessly with applications of interest in science and engineering.

Targeted at graduate students, researchers and practitioners in the field of science and engineering, this book gives a self-contained introduction to a measure-theoretic framework in laying out the definitions and basic concepts of random variables and stochastic diffusion processes. It then continues to weave into a framework of several practical tools and applications involving stochastic dynamical systems. These include tools for the numerical integration of such dynamical systems, nonlinear stochastic filtering and generalized Bayesian update theories for solving inverse problems and a new stochastic search technique for treating a broad class of non-convex optimization problems. MATLAB® codes for all the applications are uploaded on the companion website.

This volume is a collection of research works to honor the late Professor Mark H.A. Davis, whose pioneering work in the areas of Stochastic Processes, Filtering, and Stochastic Optimization spans more than five decades. Invited authors include his dissertation advisor, past collaborators, colleagues, mentees, and graduate students of Professor Davis, as well as scholars who have worked in the above areas. Their contributions may expand upon topics in piecewise deterministic processes, pathwise stochastic calculus, martingale methods in stochastic optimization, filtering, mean-field games, time-inconsistency, as well as impulse, singular, risk-sensitive and robust stochastic control.

This comprehensive textbook covers both classical and geometric aspects of optimization using methods, deterministic and stochastic, in a single volume and in a language accessible to non-mathematicians. It will help serve as an ideal study material for senior undergraduate and graduate students in the fields of civil, mechanical, aerospace, electrical, electronics, and communication engineering. The book includes: Derivative-based Methods of Optimization. Direct Search Methods of Optimization. Basics of Riemannian Differential Geometry. Geometric Methods of Optimization using Riemannian Langevin Dynamics. Stochastic Analysis on Manifolds and Geometric Optimization Methods. This textbook comprehensively treats both classical and geometric optimization methods, including deterministic and stochastic (Monte Carlo) schemes. It offers an extensive coverage of important topics including derivative-based methods, penalty function methods, method of gradient projection, evolutionary methods, geometric search using Riemannian Langevin dynamics and stochastic dynamics on manifolds. The textbook is accompanied by online resources including MATLAB codes which are uploaded on our website. The textbook is primarily written for senior undergraduate and graduate students in all applied science and engineering disciplines and can be used as a main or supplementary text for courses on classical and geometric optimization.

This volume collects papers, based on invited talks given at the IMA workshop in Modeling, Stochastic Control, Optimization, and Related Applications, held at the Institute for Mathematics and Its Applications, University of Minnesota, during May and June, 2018. There were four week-long workshops during the conference. They are (1) stochastic control, computation methods, and applications, (2) queueing theory and networked systems, (3) ecological and biological applications, and (4) finance and economics applications. For broader impacts, researchers from different fields covering both theoretically oriented and application intensive areas were invited to participate in the conference. It brought together researchers from multi-disciplinary communities in applied mathematics, applied probability, engineering, biology, ecology, and networked science, to review, and substantially update most recent progress. As an archive, this volume presents some of the highlights of the workshops, and collect papers covering a broad range of topics.

Nonlinear Stochastic Control and Filtering with Engineering-oriented Complexities presents a series of control and filtering approaches for stochastic systems with traditional and emerging engineering-oriented complexities. The book begins with an overview of the relevant background, motivation, and research problems, and then: Discusses the robust stability and stabilization problems for a class of stochastic time-delay interval systems with nonlinear disturbances Investigates the robust stabilization and H∞ control problems for a class of stochastic time-delay uncertain systems with Markovian switching and nonlinear disturbances Explores the H∞ state estimator and H∞ output feedback controller design issues for stochastic time-delay systems with nonlinear disturbances, sensor nonlinearities, and Markovian jumping parameters Analyzes the H∞ performance for a general class of nonlinear stochastic systems with time delays, where the addressed systems are described by general stochastic functional differential equations Studies the filtering problem for a class of discrete-time stochastic nonlinear time-delay systems with missing measurement and stochastic disturbances Uses gain-scheduling techniques to tackle the probability-dependent control and filtering problems for time-varying nonlinear systems with incomplete information Evaluates the filtering problem for a class of discrete-time stochastic nonlinear networked control systems with multiple random communication delays and random packet losses Examines the filtering problem for a class of nonlinear genetic regulatory networks with state-dependent stochastic disturbances and state delays Considers the H∞ state estimation problem for a class of discrete-time complex networks with probabilistic missing measurements and randomly occurring coupling delays Addresses the H∞ synchronization control problem for a class of dynamical networks with randomly varying nonlinearities Nonlinear Stochastic Control and Filtering with Engineering-oriented Complexities describes novel methodologies that can be applied extensively in lab simulations, field experiments, and real-world engineering practices. Thus, this text provides a valuable reference for researchers and professionals in the signal processing and control engineering communities.

In this book, control and filtering problems for several classes of stochastic networked systems are discussed. In each chapter, the stability, robustness, reliability, consensus performance, and/or disturbance attenuation levels are investigated within a unified theoretical framework. The aim is to derive the sufficient conditions such that the resulting systems achieve the prescribed design requirements despite all the network-induced phenomena. Further, novel notions such as randomly occurring sensor failures and consensus in probability are discussed. Finally, the theories/techniques developed are applied to emerging research areas. Key Features Unifies existing and emerging concepts concerning stochastic control/filtering and distributed control/filtering with an emphasis on a variety of network-induced complexities Includes concepts like randomly occurring sensor failures and consensus in probability (with respect to time-varying stochastic multi-agent systems) Exploits the recursive linear matrix inequality approach, completing the square method, Hamilton-Jacobi inequality approach, and parameter-dependent matrix inequality approach to handle the emerging mathematical/computational challenges Captures recent advances of theories, techniques, and applications of stochastic control as well as filtering from an engineering-oriented perspective Gives simulation examples in each chapter to reflect the engineering practice

Stochastic Optimization Algorithms have become essential tools in solving a wide range of difficult and critical optimization problems. Such methods are able to find the optimum solution of a problem with uncertain elements or to algorithmically incorporate uncertainty to solve a deterministic problem. They even succeed in fighting uncertainty with uncertainty. This book discusses theoretical aspects of many such algorithms and covers their application in various scientific fields.