The Taichi High-Performance and Differentiable Programming Language for Sparse and Quantized Visual Computing
Name
Hu-yuanming-PhD-EECS-2021-thesis.pdf
Description
Thesis PDF
Size
24.79 MB
Format
Adobe PDF
Checksum (MD5)
89bca8bb465d40a8198c4ce2e17c0093
Author(s)
Hu, Yuanming
Advisor(s)
Durand, Frédo
Freeman, William T.
Date Issued
June 2021
Publisher
Massachusetts Institute of Technology
Abstract
Using traditional programming languages such as C++ and CUDA, writing high-performance visual computing code is often laborious and requires deep expertise in performance engineering. This implies an undesirable trade-off between performance and productivity. Emerging visual computing workloads such as sparse data structure operations, differentiable programming, and quantized computation, lead to further development difficulties with existing programming systems. To address these issues, we propose Taichi, an imperative and parallel programming language, tailored for developing high-performance visual computing systems. Taichi leverages domain-specific features of visual computing tasks, providing first-class abstraction and support for spatially sparse computation, differentiable programming, and quantization. With Taichi’s optimizing compiler that has a high-level understanding of these domain-specific language constructs and automatically optimizes Taichi programs, we achieve performance and productivity simultaneously in various visual computing tasks, especially physical simulation. For example, with Taichi we can easily achieve 4.55× higher performance using 1/10 lines of code on sparse computations, effortlessly develop 10 differentiable physical simulators, and simulate unprecedented 235 million material point method (MPM) particles on a single GPU.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright MIT
Persistent DSpace Link
