Stochastic Control And Mathematical Modeling

This is a concise and elementary introduction to stochastic control and mathematical modeling. This book is designed for researchers in stochastic control theory studying its application in mathematical economics and those in economics who are interested in mathematical theory in control. It is also a good guide for graduate students studying applied mathematics, mathematical economics, and non-linear PDE theory. Contents include the basics of analysis and probability, the theory of stochastic differential equations, variational problems, problems in optimal consumption and in optimal stopping, optimal pollution control, and solving the HJB equation with boundary conditions. Major mathematical requisitions are contained in the preliminary chapters or in the appendix so that readers can proceed without referring to other materials.

Introduces stochastic control and mathematical modelling to researchers and graduate students in applied mathematics, mathematical economics, and non-linear PDE theory.

This volume collects papers, based on invited talks given at the IMA workshop in Modeling, Stochastic Control, Optimization, and Related Applications, held at the Institute for Mathematics and Its Applications, University of Minnesota, during May and June, 2018. There were four week-long workshops during the conference. They are (1) stochastic control, computation methods, and applications, (2) queueing theory and networked systems, (3) ecological and biological applications, and (4) finance and economics applications. For broader impacts, researchers from different fields covering both theoretically oriented and application intensive areas were invited to participate in the conference. It brought together researchers from multi-disciplinary communities in applied mathematics, applied probability, engineering, biology, ecology, and networked science, to review, and substantially update most recent progress. As an archive, this volume presents some of the highlights of the workshops, and collect papers covering a broad range of topics.

As is well known, Pontryagin's maximum principle and Bellman's dynamic programming are the two principal and most commonly used approaches in solving stochastic optimal control problems. * An interesting phenomenon one can observe from the literature is that these two approaches have been developed separately and independently. Since both methods are used to investigate the same problems, a natural question one will ask is the fol lowing: (Q) What is the relationship betwccn the maximum principlc and dy namic programming in stochastic optimal controls? There did exist some researches (prior to the 1980s) on the relationship between these two. Nevertheless, the results usually werestated in heuristic terms and proved under rather restrictive assumptions, which were not satisfied in most cases. In the statement of a Pontryagin-type maximum principle there is an adjoint equation, which is an ordinary differential equation (ODE) in the (finite-dimensional) deterministic case and a stochastic differential equation (SDE) in the stochastic case. The system consisting of the adjoint equa tion, the original state equation, and the maximum condition is referred to as an (extended) Hamiltonian system. On the other hand, in Bellman's dynamic programming, there is a partial differential equation (PDE), of first order in the (finite-dimensional) deterministic case and of second or der in the stochastic case. This is known as a Hamilton-Jacobi-Bellman (HJB) equation.

Stochastic optimization problems arise in decision-making problems under uncertainty, and find various applications in economics and finance. On the other hand, problems in finance have recently led to new developments in the theory of stochastic control. This volume provides a systematic treatment of stochastic optimization problems applied to finance by presenting the different existing methods: dynamic programming, viscosity solutions, backward stochastic differential equations, and martingale duality methods. The theory is discussed in the context of recent developments in this field, with complete and detailed proofs, and is illustrated by means of concrete examples from the world of finance: portfolio allocation, option hedging, real options, optimal investment, etc. This book is directed towards graduate students and researchers in mathematical finance, and will also benefit applied mathematicians interested in financial applications and practitioners wishing to know more about the use of stochastic optimization methods in finance.

This book aims to provide a unified treatment of input/output modelling and of control for discrete-time dynamical systems subject to random disturbances. The results presented are of wide applica bility in control engineering, operations research, econometric modelling and many other areas. There are two distinct approaches to mathematical modelling of physical systems: a direct analysis of the physical mechanisms that comprise the process, or a 'black box' approach based on analysis of input/output data. The second approach is adopted here, although of course the properties ofthe models we study, which within the limits of linearity are very general, are also relevant to the behaviour of systems represented by such models, however they are arrived at. The type of system we are interested in is a discrete-time or sampled-data system where the relation between input and output is (at least approximately) linear and where additive random dis turbances are also present, so that the behaviour of the system must be investigated by statistical methods. After a preliminary chapter summarizing elements of probability and linear system theory, we introduce in Chapter 2 some general linear stochastic models, both in input/output and state-space form. Chapter 3 concerns filtering theory: estimation of the state of a dynamical system from noisy observations. As well as being an important topic in its own right, filtering theory provides the link, via the so-called innovations representation, between input/output models (as identified by data analysis) and state-space models, as required for much contemporary control theory.

This volume builds upon the foundations set in Volumes 1 and 2. Chapter 13 introduces the basic concepts of stochastic control and dynamic programming as the fundamental means of synthesizing optimal stochastic control laws.

​This book collects some recent developments in stochastic control theory with applications to financial mathematics. We first address standard stochastic control problems from the viewpoint of the recently developed weak dynamic programming principle. A special emphasis is put on the regularity issues and, in particular, on the behavior of the value function near the boundary. We then provide a quick review of the main tools from viscosity solutions which allow to overcome all regularity problems. We next address the class of stochastic target problems which extends in a nontrivial way the standard stochastic control problems. Here the theory of viscosity solutions plays a crucial role in the derivation of the dynamic programming equation as the infinitesimal counterpart of the corresponding geometric dynamic programming equation. The various developments of this theory have been stimulated by applications in finance and by relevant connections with geometric flows. Namely, the second order extension was motivated by illiquidity modeling, and the controlled loss version was introduced following the problem of quantile hedging. The third part specializes to an overview of Backward stochastic differential equations, and their extensions to the quadratic case.​

Yet again, here is a Springer volume that offers readers something completely new. Until now, solved examples of the application of stochastic control to actuarial problems could only be found in journals. Not any more: this is the first book to systematically present these methods in one volume. The author starts with a short introduction to stochastic control techniques, then applies the principles to several problems. These examples show how verification theorems and existence theorems may be proved, and that the non-diffusion case is simpler than the diffusion case. Schmidli’s brilliant text also includes a number of appendices, a vital resource for those in both academic and professional settings.

In this book, we study theoretical and practical aspects of computing methods for mathematical modelling of nonlinear systems. A number of computing techniques are considered, such as methods of operator approximation with any given accuracy; operator interpolation techniques including a non-Lagrange interpolation; methods of system representation subject to constraints associated with concepts of causality, memory and stationarity; methods of system representation with an accuracy that is the best within a given class of models; methods of covariance matrix estimation;methods for low-rank matrix approximations; hybrid methods based on a combination of iterative procedures and best operator approximation; andmethods for information compression and filtering under condition that a filter model should satisfy restrictions associated with causality and different types of memory.As a result, the book represents a blend of new methods in general computational analysis,and specific, but also generic, techniques for study of systems theory ant its particularbranches, such as optimal filtering and information compression. - Best operator approximation,- Non-Lagrange interpolation,- Generic Karhunen-Loeve transform- Generalised low-rank matrix approximation- Optimal data compression- Optimal nonlinear filtering