Preconditioning And The Conjugate Gradient Method In The Context Of Solving Pdes

Preconditioning and the Conjugate Gradient Method in the Context of Solving PDEs is about the interplay between modeling, analysis, discretization, matrix computation, and model reduction. The authors link PDE analysis, functional analysis, and calculus of variations with matrix iterative computation using Krylov subspace methods and address the challenges that arise during formulation of the mathematical model through to efficient numerical solution of the algebraic problem. The book?s central concept, preconditioning of the conjugate gradient method, is traditionally developed algebraically using the preconditioned finite-dimensional algebraic system. In this text, however, preconditioning is connected to the PDE analysis, and the infinite-dimensional formulation of the conjugate gradient method and its discretization and preconditioning are linked together. This text challenges commonly held views, addresses widespread misunderstandings, and formulates thought-provoking open questions for further research.

The conjugate gradient (CG) algorithm is almost always the iterative method of choice for solving linear systems with symmetric positive definite matrices. This book describes and analyzes techniques based on Gauss quadrature rules to cheaply compute bounds on norms of the error. The techniques can be used to derive reliable stopping criteria. How to compute estimates of the smallest and largest eigenvalues during CG iterations is also shown. The algorithms are illustrated by many numerical experiments, and they can be easily incorporated into existing CG codes. The book is intended for those in academia and industry who use the conjugate gradient algorithm, including the many branches of science and engineering in which symmetric linear systems have to be solved.

The position taken in this collection of pedagogically written essays is that conjugate gradient algorithms and finite element methods complement each other extremely well. Via their combinations practitioners have been able to solve complicated, direct and inverse, multidemensional problems modeled by ordinary or partial differential equations and inequalities, not necessarily linear, optimal control and optimal design being part of these problems. The aim of this book is to present both methods in the context of complicated problems modeled by linear and nonlinear partial differential equations, to provide an in-depth discussion on their implementation aspects. The authors show that conjugate gradient methods and finite element methods apply to the solution of real-life problems. They address graduate students as well as experts in scientific computing.

This book provides essential lecture notes on solving large linear saddle-point systems, which arise in a wide range of applications and often pose computational challenges in science and engineering. The focus is on discussing the particular properties of such linear systems, and a large selection of algebraic methods for solving them, with an emphasis on iterative methods and preconditioning. The theoretical results presented here are complemented by a case study on potential fluid flow problem in a real world-application. This book is mainly intended for students of applied mathematics and scientific computing, but also of interest for researchers and engineers working on various applications. It is assumed that the reader has completed a basic course on linear algebra and numerical mathematics.

The volume features high-quality papers based on the presentations at the ICOSAHOM 2020+1 on spectral and high order methods. The carefully reviewed articles cover state of the art topics in high order discretizations of partial differential equations. The volume presents a wide range of topics including the design and analysis of high order methods, the development of fast solvers on modern computer architecture, and the application of these methods in fluid and structural mechanics computations.

The use of scientific computing tools is currently customary for solving problems at several complexity levels in Applied Sciences. The great need for reliable software in the scientific community conveys a continuous stimulus to develop new and better performing numerical methods that are able to grasp the particular features of the problem at hand. This has been the case for many different settings of numerical analysis, and this Special Issue aims at covering some important developments in various areas of application.

Numerous applications, including computational optimization and fluid dynamics, give rise to block linear systems of equations said to have the quasi-definite structure. In practical situations, the size or density of those systems can preclude a factorization approach, leaving only iterative methods as the solution technique. Known iterative methods, however, are not specifically designed to take advantage of the quasi-definite structure. This book discusses the connection between quasi-definite systems and linear least-squares problems, the most common and best understood problems in applied mathematics, and explains how quasi-definite systems can be solved using tailored iterative methods for linear least squares (with half as much work!). To encourage researchers and students to use the software, it is provided in MATLAB, Python, and Julia. The authors provide a concise account of the most well-known methods for symmetric systems and least-squares problems, research-level advances in the solution of problems with specific illustrations in optimization and fluid dynamics, and a website that hosts software in three languages.

In this paper, we present a class of iterative descent methods for solving large, sparse, nonsymmetric systems of linear equations whose coefficient matrices have positive-definite symmetric parts. Such problems commonly arise from the discretization of non-self-adjoint elliptic partial differential equations. The methods we consider are modelled after the conjugate gradient method. They require no estimation of parameters and their rate of convergence appears to depend on the spectrum of A rather than ATA. Their convergence can also be accelerated by preconditioning techniques.

All relevant implementation aspects of finite element methods are discussed in this book. The focus is on algorithms and data structures as well as on their concrete implementation. Theory is covered only as far as it gives insight into the construction of algorithms. In the exercises, a complete FE-solver for stationary 2D problems is implemented in Matlab/Octave. Contents: Finite Element Fundamentals Grids and Finite Elements Assembly Solvers Error Estimation Mesh Refinement Multigrid Elastomechanics Fluid Mechanics Grid Data Structure Function Reference