Stochastic Systems

Since its origins in the 1940s, the subject of decision making under uncertainty has grown into a diversified area with application in several branches of engineering and in those areas of the social sciences concerned with policy analysis and prescription. These approaches required a computing capacity too expensive for the time, until the ability to collect and process huge quantities of data engendered an explosion of work in the area. This book provides succinct and rigorous treatment of the foundations of stochastic control; a unified approach to filtering, estimation, prediction, and stochastic and adaptive control; and the conceptual framework necessary to understand current trends in stochastic control, data mining, machine learning, and robotics.

Complex stochastic systems comprises a vast area of research, from modelling specific applications to model fitting, estimation procedures, and computing issues. The exponential growth in computing power over the last two decades has revolutionized statistical analysis and led to rapid developments and great progress in this emerging field. In Complex Stochastic Systems, leading researchers address various statistical aspects of the field, illustrated by some very concrete applications. A Primer on Markov Chain Monte Carlo by Peter J. Green provides a wide-ranging mixture of the mathematical and statistical ideas, enriched with concrete examples and more than 100 references. Causal Inference from Graphical Models by Steffen L. Lauritzen explores causal concepts in connection with modelling complex stochastic systems, with focus on the effect of interventions in a given system. State Space and Hidden Markov Models by Hans R. Künschshows the variety of applications of this concept to time series in engineering, biology, finance, and geophysics. Monte Carlo Methods on Genetic Structures by Elizabeth A. Thompson investigates special complex systems and gives a concise introduction to the relevant biological methodology. Renormalization of Interacting Diffusions by Frank den Hollander presents recent results on the large space-time behavior of infinite systems of interacting diffusions. Stein's Method for Epidemic Processes by Gesine Reinert investigates the mean field behavior of a general stochastic epidemic with explicit bounds. Individually, these articles provide authoritative, tutorial-style exposition and recent results from various subjects related to complex stochastic systems. Collectively, they link these separate areas of study to form the first comprehensive overview of this rapidly developing field.

This book presents a treatise on the theory and modeling of second-order stationary processes, including an exposition on selected application areas that are important in the engineering and applied sciences. The foundational issues regarding stationary processes dealt with in the beginning of the book have a long history, starting in the 1940s with the work of Kolmogorov, Wiener, Cramér and his students, in particular Wold, and have since been refined and complemented by many others. Problems concerning the filtering and modeling of stationary random signals and systems have also been addressed and studied, fostered by the advent of modern digital computers, since the fundamental work of R.E. Kalman in the early 1960s. The book offers a unified and logically consistent view of the subject based on simple ideas from Hilbert space geometry and coordinate-free thinking. In this framework, the concepts of stochastic state space and state space modeling, based on the notion of the conditional independence of past and future flows of the relevant signals, are revealed to be fundamentally unifying ideas. The book, based on over 30 years of original research, represents a valuable contribution that will inform the fields of stochastic modeling, estimation, system identification, and time series analysis for decades to come. It also provides the mathematical tools needed to grasp and analyze the structures of algorithms in stochastic systems theory.

Uncertainty is an inherent feature of both properties of physical systems and the inputs to these systems that needs to be quantified for cost effective and reliable designs. The states of these systems satisfy equations with random entries, referred to as stochastic equations, so that they are random functions of time and/or space. The solution of stochastic equations poses notable technical difficulties that are frequently circumvented by heuristic assumptions at the expense of accuracy and rigor. The main objective of Stochastic Systems is to promoting the development of accurate and efficient methods for solving stochastic equations and to foster interactions between engineers, scientists, and mathematicians. To achieve these objectives Stochastic Systems presents: A clear and brief review of essential concepts on probability theory, random functions, stochastic calculus, Monte Carlo simulation, and functional analysis Probabilistic models for random variables and functions needed to formulate stochastic equations describing realistic problems in engineering and applied sciences Practical methods for quantifying the uncertain parameters in the definition of stochastic equations, solving approximately these equations, and assessing the accuracy of approximate solutions Stochastic Systems provides key information for researchers, graduate students, and engineers who are interested in the formulation and solution of stochastic problems encountered in a broad range of disciplines. Numerous examples are used to clarify and illustrate theoretical concepts and methods for solving stochastic equations. The extensive bibliography and index at the end of the book constitute an ideal resource for both theoreticians and practitioners.

This comprehensive introduction to the estimation and control of dynamic stochastic systems provides complete derivations of key results. The second edition includes improved and updated material, and a new presentation of polynomial control and new derivation of linear-quadratic-Gaussian control.

This book provides a self-contained review of all the relevant topics in probability theory. A software package called MAXIM, which runs on MATLAB, is made available for downloading. Vidyadhar G. Kulkarni is Professor of Operations Research at the University of North Carolina at Chapel Hill.

Through this text, the author aims to make recent developments in the title subject (a modern strategy for the creation of statistical models to solve 'real world' problems) accessible to graduate students and researchers in the field of statistics.

Fluctuating parameters appear in a variety of physical systems and phenomena. They typically come either as random forces/sources, or advecting velocities, or media (material) parameters, like refraction index, conductivity, diffusivity, etc. The well known example of Brownian particle suspended in fluid and subjected to random molecular bombardment laid the foundation for modern stochastic calculus and statistical physics. Other important examples include turbulent transport and diffusion of particle-tracers (pollutants), or continuous densities (''oil slicks''), wave propagation and scattering in randomly inhomogeneous media, for instance light or sound propagating in the turbulent atmosphere. Such models naturally render to statistical description, where the input parameters and solutions are expressed by random processes and fields. The fundamental problem of stochastic dynamics is to identify the essential characteristics of system (its state and evolution), and relate those to the input parameters of the system and initial data. This raises a host of challenging mathematical issues. One could rarely solve such systems exactly (or approximately) in a closed analytic form, and their solutions depend in a complicated implicit manner on the initial-boundary data, forcing and system's (media) parameters . In mathematical terms such solution becomes a complicated "nonlinear functional" of random fields and processes. Part I gives mathematical formulation for the basic physical models of transport, diffusion, propagation and develops some analytic tools. Part II sets up and applies the techniques of variational calculus and stochastic analysis, like Fokker-Plank equation to those models, to produce exact or approximate solutions, or in worst case numeric procedures. The exposition is motivated and demonstrated with numerous examples. Part III takes up issues for the coherent phenomena in stochastic dynamical systems, described by ordinary and partial differential equations, like wave propagation in randomly layered media (localization), turbulent advection of passive tracers (clustering). Each chapter is appended with problems the reader to solve by himself (herself), which will be a good training for independent investigations. · This book is translation from Russian and is completed with new principal results of recent research.· The book develops mathematical tools of stochastic analysis, and applies them to a wide range of physical models of particles, fluids, and waves.· Accessible to a broad audience with general background in mathematical physics, but no special expertise in stochastic analysis, wave propagation or turbulence

Over the past decades, although stochastic system control has been studied intensively within the field of control engineering, all the modelling and control strategies developed so far have concentrated on the performance of one or two output properties of the system. such as minimum variance control and mean value control. The general assumption used in the formulation of modelling and control strategies is that the distribution of the random signals involved is Gaussian. In this book, a set of new approaches for the control of the output probability density function of stochastic dynamic systems (those subjected to any bounded random inputs), has been developed. In this context, the purpose of control system design becomes the selection of a control signal that makes the shape of the system outputs p.d.f. as close as possible to a given distribution. The book contains material on the subjects of: - Control of single-input single-output and multiple-input multiple-output stochastic systems; - Stable adaptive control of stochastic distributions; - Model reference adaptive control; - Control of nonlinear dynamic stochastic systems; - Condition monitoring of bounded stochastic distributions; - Control algorithm design; - Singular stochastic systems. A new representation of dynamic stochastic systems is produced by using B-spline functions to descripe the output p.d.f. Advances in Industrial Control aims to report and encourage the transfer of technology in control engineering. The rapid development of control technology has an impact on all areas of the control discipline. The series offers an opportunity for researchers to present an extended exposition of new work in all aspects of industrial control.

Two-scale systems described by singularly perturbed SDEs have been the subject of ample literature. However, this new monograph develops subjects that were rarely addressed and could be given the collective description "Stochastic Tikhonov-Levinson theory and its applications." The book provides a mathematical apparatus designed to analyze the dynamic behaviour of a randomly perturbed system with fast and slow variables. In contrast to the deterministic Tikhonov-Levinson theory, the basic model is described in a more realistic way by stochastic differential equations. This leads to a number of new theoretical questions but simultaneously allows us to treat in a unified way a surprisingly wide spectrum of applications like fast modulations, approximate filtering, and stochastic approximation.Two-scale systems described by singularly perturbed SDEs have been the subject of ample literature. However, this new monograph develops subjects that were rarely addressed and could be given the collective description "Stochastic Tikhonov-Levinson theory and its applications." The book provides a mathematical apparatus designed to analyze the dynamic behaviour of a randomly perturbed system with fast and slow variables. In contrast to the deterministic Tikhonov-Levinson theory, the basic model is described in a more realistic way by stochastic differential equations. This leads to a number of new theoretical questions but simultaneously allows us to treat in a unified way a surprisingly wide spectrum of applications like fast modulations, approximate filtering, and stochastic approximation.