Show simple item record

dc.contributor.advisorDurand, Frédo
dc.contributor.authorBangaru, Sai Praveen
dc.date.accessioned2024-08-21T18:57:11Z
dc.date.available2024-08-21T18:57:11Z
dc.date.issued2024-05
dc.date.submitted2024-07-10T13:01:24.932Z
dc.identifier.urihttps://hdl.handle.net/1721.1/156329
dc.description.abstractDifferentiable graphics representations are now a centerpiece for learning-based approaches in inverse rendering, novel-view synthesis, data & compute efficient rendering, and even 3D generative models. We see great advances in performance & fidelity when mixing classical wisdom from existing primitives like meshes and textures, and novel primitives like tiny neural networks. This cross-pollination of ML & graphics is key to these advances, but is held back due to complications: existing frameworks like PyTorch are ill-suited to graphics programming both due to algorithmic problems, like discontinuities, and system-design problems that lead to poor performance & expressive power. This thesis discusses several original approaches that were developed with generalizability in mind, to allow these approaches to apply broadly to different domains that struggle with the same problems. The first half of this thesis tackles discontinuities in a wide variety of applications, both (i) through a compiler that takes the problem-specific boundary sampling idea and automates it through compiler passes, and (ii) the warped-area reparameterization method that can be used to handle discontinuities by entirely removing the requirement of such problem-specific boundary samplers. We show how this enables light-weight integration with existing renderers by reparameterizing a mesh-based path tracer and a neural SDF renderer to make them fully differentiable. The second half will present the SLANG.D compiler, an industry collaboration that resulted in a high-performance compiler for next-generation differentiable & neural graphics systems. We discuss how the user-centric focus of SLANG.D’s automatic differentiation system enables users to write large-scale differentiable graphics pipelines and re-use 1000s of lines of existing rendering infrastructure without sacrificing its performance.
dc.publisherMassachusetts Institute of Technology
dc.rightsAttribution 4.0 International (CC BY 4.0)
dc.rightsCopyright retained by author(s)
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.titleAlgorithms & Systems for Differentiable Graphics Programming
dc.typeThesis
dc.description.degreePh.D.
dc.contributor.departmentMassachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
mit.thesis.degreeDoctoral
thesis.degree.nameDoctor of Philosophy


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record