Structured Diffusion Processes in Deep Generative Models
Name
Jing-bjing-SM-EECS-2022-thesis.pdf
Description
Thesis PDF
Size
5.52 MB
Format
Adobe PDF
Checksum (MD5)
49d6fa56ca755709f9f95c006a6be47b
Author(s)
Jing, Bowen
Advisor(s)
Jaakkola, Tommi
Date Issued
September 2022
Publisher
Massachusetts Institute of Technology
Abstract
Diffusion generative models have emerged as a powerful, versatile, and elegant generative modeling framework for diverse data modalities. However, the high computational cost of inference relative to other frameworks remains a chief limitation of such models. At the same time, the design space of a key component in their formulation—the forward diffusion process—has been underexplored. This thesis proposes a paradigm to accelerate and improve diffusion generative models by tailoring structured forward diffusion processes to the generative modeling problem at hand.
Case studies of structured diffusion processes are developed and presented for (1) natural images and (2) molecular conformers. First, the subspace structure in images is exploited to develop subspace diffusion, a forward diffusion process that restricts the diffusion via projections to subspaces of decreasing dimensionality. Second, chemical constraints in molecular conformers are exploited to develop torsional diffusion, a forward process that preserves those constraints by operating over a lower-dimensional, non-Euclidean space. Both approaches simultaneously improve sample quality and reduce inference runtime while preserving existing capabilities—and developing new ones—of diffusion generative models.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright retained by author(s)
Persistent DSpace Link
