Compiler-Enhanced Numerical Algorithms beyond Automatic Differentiation
Name
tan-songchen-dsc-mathcse-2026-thesis.pdf
Size
2.44 MB
Format
Adobe PDF
Checksum (MD5)
f81d046e67f4b9ad63e3a03af5acc499
Author(s)
Tan, Songchen
Advisor(s)
Edelman, Alan S.
Date Issued
May 2026
Publisher
Massachusetts Institute of Technology
Abstract
Automatic differentiation occupies a central role in numerical algorithms for nonlinear equations, differential equations, and optimization. This thesis reinterprets automatic differentiation as a paradigm of program transformation enabled by modern compiler techniques, and explores how such techniques can systematically generate not only derivatives but also a broader class of algorithmic components from user-defined programs. By introducing principles of symbolic-numeric computing that leverage symbolic intermediate representations, the thesis establishes a unified framework for arbitrary-order differentiation and the automatic synthesis of high-level algorithmic components. These methods are then applied to develop advanced algorithms for solving nonlinear equations, numerical continuation, and ordinary differential equations. Through both theoretical insights and practical tool development, the thesis demonstrates that compiler techniques can significantly enhance the efficiency, flexibility, and capabilities of numerical computation.
MIT Department
Massachusetts Institute of Technology. Department of Mathematics
Massachusetts Institute of Technology. Center for Computational Science and Engineering
Terms of Use
In Copyright - Educational Use Permitted
Copyright retained by author(s)
Persistent DSpace Link
