Advanced Search

The Video Mesh: A Data Structure for Image-based Video Editing

Research and Teaching Output of the MIT Community

Show simple item record

dc.contributor.advisor Fredo Durand Durand, Fredo en_US Cohen, Michael en_US Chen, Jiawen en_US Paris, Sylvain en_US Wang, Jue en_US Matusik, Wojciech en_US
dc.contributor.other Computer Graphics en 2009-12-17T19:15:09Z 2009-12-17T19:15:09Z 2009-12-16
dc.description.abstract This paper introduces the video mesh, a data structure for representing video as 2.5D "paper cutouts." The video mesh allows interactive editing of moving objects and modeling of depth, which enables 3D effects and post-exposure camera control. The video mesh sparsely encodes optical flow as well as depth, and handles occlusion using local layering and alpha mattes. Motion is described by a sparse set of points tracked over time. Each point also stores a depth value. The video mesh is a triangulation over this point set and per-pixel information is obtained by interpolation. The user rotoscopes occluding contours and we introduce an algorithm to cut the video mesh along them. Object boundaries are refined with perpixel alpha values. The video mesh is at its core a set of texture mapped triangles, we leverage graphics hardware to enable interactive editing and rendering of a variety of effects. We demonstrate the effectiveness of our representation with a number of special effects including 3D viewpoint changes, object insertion, and depth-of-field manipulation. en_US
dc.format.extent 9 p. en_US
dc.relation.ispartofseries MIT-CSAIL-TR-2009-062
dc.rights Creative Commons Attribution-Noncommercial 3.0 Unported en
dc.subject feature tracking en_US
dc.subject compositing en_US
dc.subject video editing en_US
dc.subject optical flow en_US
dc.subject triangle mesh en_US
dc.title The Video Mesh: A Data Structure for Image-based Video Editing en_US
dc.identifier.citation CHEN, J., PARIS, S., WANG, J., MATUSIK, W., COHEN, M., and DURAND, F. 2009. The Video Mesh: A Data Structure for Image-based Video Editing. MIT Computer Science and Artificial Intelligence Laboratory Technical Report Series, MIT-CSAIL-TR-2009-062.

Files in this item

Name Size Format Description
MIT-CSAIL-TR-2009 ... 8.548Mb PDF

The following license files are associated with this item:

This item appears in the following Collection(s)

Show simple item record

Creative Commons Attribution-Noncommercial 3.0 Unported Except where otherwise noted, this item's license is described as Creative Commons Attribution-Noncommercial 3.0 Unported