ChemInk: A Natural Real-Time Recognition System for Chemical Drawings
Name
ouyang_iui2011.pdf
Size
404.63 KB
Format
Adobe PDF
Checksum (MD5)
b2b1c230ed51ff44c6e90449e4878d07
Author(s)
Ouyang, Tom Y.
Davis, Randall
Date Issued
2011
Journal
Proceedings of the 16th International Conference on Intelligent User Interfaces
Publisher
Association for Computing Machinery (ACM)
Citation
Ouyang, Tom Y., and Randall Davis. “ChemInk: A Natural Real-Time Recognition System for Chemical Drawings.” Proceedings of the 16th International Conference on Intelligent User Interfaces 2011: 267-276.
Version
Author's final manuscript
Abstract
We describe a new sketch recognition framework for chemical structure drawings that combines multiple levels of visual features using a jointly trained conditional random field. This joint model of appearance at different levels of detail makes our framework less sensitive to noise and drawing variations, improving accuracy and robustness. In addition, we present a novel learning-based approach to corner detection that achieves nearly perfect accuracy in our domain. The result is a recognizer that is better able to handle the wide range of drawing styles found in messy freehand sketches. Our system handles both graphics and text, producing a complete molecular structure as output. It works in real time, providing visual feedback about the recognition progress. On a dataset of chemical drawings our system achieved an accuracy rate of 97.4%, an improvement over the best reported results in literature. A preliminary user study also showed that participants were on average over twice as fast using our sketch-based system compared to ChemDraw, a popular CAD-based tool for authoring chemical diagrams. This was the case even though most of the users had years of experience using ChemDraw and little or no experience using Tablet PCs.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike 3.0
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/1943403.1943444
