Motion sculptures : automating artistic visualization of shape and time
Name
1051460431-MIT.pdf
Description
Full printable version
Size
26.49 MB
Format
Adobe PDF
Checksum (MD5)
fd99410c0cf498360124b2f03c32439b
Author(s)
Zhang, Xiuming (Scientist in electrical engineering and computer science) Massachusetts Institute of Technology
Advisor(s)
William T. Freeman.
Alternative Title
Automating artistic visualization of shape and time
Date Issued
2018
Publisher
Massachusetts Institute of Technology
Abstract
We present a method for automatically visualizing complex human and object motion via 3D motion sculptures -- a representation that conveys the 3D structure swept by the human's body as it moves through space. Given only a monocular RGB video as input, our algorithm computes the motion sculpture by estimating the object's 3D geometry over time, and then renders the motion sculpture under different rendering styles such as sculpture material, scene lighting, and floor reflections. We develop a 3D-aware image-based rendering approach to insert motion sculptures into a synthetic scene or back into the original video. This results in high-quality artistic visualizations of motion. Because motion sculptures are 3D, they can be viewed from arbitrary viewpoints and even physically printed. As such, they may reveal space-time information that is undetected by the naked eyes and allow the viewer to interpret how different parts of the object interact over time. Our method automates the process of motion sculpture creation, making this manual process typically done only by professional artists accessible to novice users and applicable to standard videos. We show results on various scenes involving complex motions such as sports actions and dancing.
Description
Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2018.
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (pages 53-55).
Subjects
Electrical Engineering and Computer Science.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.
Persistent DSpace Link
