Advanced Search
DSpace@MIT

The Video Mesh: A Data Structure for Image-based Video Editing

Research and Teaching Output of the MIT Community

Show simple item record

dc.contributor.advisor Fredo Durand
dc.contributor.author Durand, Fredo en_US
dc.contributor.author Cohen, Michael en_US
dc.contributor.author Chen, Jiawen en_US
dc.contributor.author Paris, Sylvain en_US
dc.contributor.author Wang, Jue en_US
dc.contributor.author Matusik, Wojciech en_US
dc.contributor.other Computer Graphics en
dc.date.accessioned 2009-12-17T19:15:09Z
dc.date.available 2009-12-17T19:15:09Z
dc.date.issued 2009-12-16
dc.identifier.uri http://hdl.handle.net/1721.1/50231
dc.description.abstract This paper introduces the video mesh, a data structure for representing video as 2.5D "paper cutouts." The video mesh allows interactive editing of moving objects and modeling of depth, which enables 3D effects and post-exposure camera control. The video mesh sparsely encodes optical flow as well as depth, and handles occlusion using local layering and alpha mattes. Motion is described by a sparse set of points tracked over time. Each point also stores a depth value. The video mesh is a triangulation over this point set and per-pixel information is obtained by interpolation. The user rotoscopes occluding contours and we introduce an algorithm to cut the video mesh along them. Object boundaries are refined with perpixel alpha values. The video mesh is at its core a set of texture mapped triangles, we leverage graphics hardware to enable interactive editing and rendering of a variety of effects. We demonstrate the effectiveness of our representation with a number of special effects including 3D viewpoint changes, object insertion, and depth-of-field manipulation. en_US
dc.format.extent 9 p. en_US
dc.relation.ispartofseries MIT-CSAIL-TR-2009-062
dc.rights Creative Commons Attribution-Noncommercial 3.0 Unported en
dc.rights.uri http://creativecommons.org/licenses/by-nc/3.0/
dc.subject feature tracking en_US
dc.subject compositing en_US
dc.subject video editing en_US
dc.subject optical flow en_US
dc.subject triangle mesh en_US
dc.title The Video Mesh: A Data Structure for Image-based Video Editing en_US
dc.identifier.citation CHEN, J., PARIS, S., WANG, J., MATUSIK, W., COHEN, M., and DURAND, F. 2009. The Video Mesh: A Data Structure for Image-based Video Editing. MIT Computer Science and Artificial Intelligence Laboratory Technical Report Series, MIT-CSAIL-TR-2009-062.


Files in this item

Name Size Format Description
MIT-CSAIL-TR-2009 ... 8.548Mb PDF

The following license files are associated with this item:

This item appears in the following Collection(s)

Show simple item record

Creative Commons Attribution-Noncommercial 3.0 Unported Except where otherwise noted, this item's license is described as Creative Commons Attribution-Noncommercial 3.0 Unported
MIT-Mirage