Deep learning-based methods for parametric shape prediction
Author(s)Smirnov, Dmitriy,S.M.Massachusetts Institute of Technology.
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.
MetadataShow full item record
Many tasks in graphics and vision demand machinery for converting shapes into representations with sparse sets of parameters; these representations facilitate rendering, editing, and storage. When the source data is noisy or ambiguous, however, artists and engineers often manually construct such representations, a tedious and potentially time-consuming process. While advances in deep learning have been successfully applied to noisy geometric data, the task of generating parametric shapes has so far been difficult for these methods. In this thesis, we consider the task of deep parametric shape prediction from two distinct angles. First, we propose a new framework for predicting parametric shape primitives using distance fields to transition between parameters like control points and input data on a raster grid. We demonstrate efficacy on 2D and 3D tasks, including font vectorization and surface abstraction. Second, we look at the problem of sketch-based modeling. Sketch-based modeling aims to model 3D geometry using a concise and easy to create but extremely ambiguous input: artist sketches. While most conventional sketch-based modeling systems target smooth shapes and put manually-designed priors on the 3D shapes, we present a system to infer a complete man-made 3D shape, composed of parametric surfaces, from a single bitmap sketch. In particular, we introduce our parametric representation as well as several specially designed loss functions. We also propose a data generation and augmentation pipeline for sketch. We demonstrate the efficacy of our system on a gallery of synthetic and real sketches as well as via comparison to related work.
Thesis: S.M., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2019Cataloged from PDF version of thesis.Includes bibliographical references (pages 67-76).
DepartmentMassachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Massachusetts Institute of Technology
Electrical Engineering and Computer Science.