Text-Driven Movie Manipulation
Name
ReyesEspinoza-vmreyes-meng-eecs-2022-thesis.pdf
Description
Thesis PDF
Size
10.54 MB
Format
Adobe PDF
Checksum (MD5)
cf14dc9492a5f4db796157cd4ad2507e
Author(s)
Reyes Espinoza, Victor M.
Advisor(s)
Materzynska, Joanna
Ma, Wei-Chiu
Torralba, Antonio
Date Issued
May 2022
Publisher
Massachusetts Institute of Technology
Abstract
In this thesis, we designed a method for manipulating a character’s appearance through a textual description of their desired appearance. Our method consisted of training a video-specific neural net model with an existing architecture for extracting keypoints, manipulating a representative frame to fit the user’s textual description through latent optimization, and producing a new video in a single forward pass. Our method requires an artist to follow 3 simple steps to manipulate a video and has only two inputs: a representative frame of the character the user wants to edit and a textual description of the desired appearance manipulation. Compared to work-intensive special effects, our method enables quick and flexible experimentation.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
In Copyright - Educational Use Permitted
Copyright MIT
Persistent DSpace Link