Andreas Griewank and Andrea Walther
Other Titles in Applied Mathematics 105
Algorithmic, or automatic, differentiation (AD) is a growing area of theoretical research and software development concerned with the accurate and efficient evaluation of derivatives for function evaluations given as computer programs. The resulting derivative values are useful for all scientific computations that are based on linear, quadratic, or higher order approximations to nonlinear scalar or vector functions.
AD has been applied in particular to optimization, parameter identification, nonlinear equation solving, the numerical integration of differential equations, and combinations of these. Apart from quantifying sensitivities numerically, AD also yields structural dependence information, such as the sparsity pattern and generic rank of Jacobian matrices. The field opens up an exciting opportunity to develop new algorithms that reflect the true cost of accurate derivatives and to use them for improvements in speed and reliability.
This second edition has been updated and expanded to cover recent developments in applications and theory, including an elegant NP completeness argument by Uwe Naumann and a brief introduction to scarcity, a generalization of sparsity. There is also added material on checkpointing and iterative differentiation. To improve readability the more detailed analysis of memory and complexity bounds has been relegated to separate, optional chapters.The book consists of three parts: a stand-alone introduction to the fundamentals of AD and its software; a thorough treatment of methods for sparse problems; and final chapters on program-reversal schedules, higher derivatives, nonsmooth problems and iterative processes. Each of the 15 chapters concludes with examples and exercises.
This volume will be valuable to designers of algorithms and software for nonlinear computational problems. Current numerical software users should gain the insight necessary to choose and deploy existing AD software tools to the best advantage.
About the Authors
Andreas Griewank is Director of the Institute of Mathematics at Humboldt University, Berlin, and a member of the DFG Research Center Matheon, Mathematics for Key Technologies. He is author of the first edition of this book, published in 2000. A former senior scientist at Argonne National Laboratory, his main research interests are nonlinear optimization and scientific computing.
Andrea Walther is Professor at the University of Paderborn. Her main research interests are scientific computing and nonlinear optimization.
algorithmic differentiation, computation of derivatives, chain rule, computational graph, adjoints.
2008 / xxii + 438 pages / Softcover / ISBN: 978-0-898716-59-7
List Price $78.00 / SIAM Member Price $54.60 / Order Code OT105