USHER: Improving data quality with dynamic forms
Author(s)
Chen, Kuang; Chen, Harr; Conway, Neil; Hellerstein, Joseph M.; Parikh, Tapan S.
DownloadChen-2010-USHER Improving data quality with dynamic forms.pdf (765.3Kb)
PUBLISHER_POLICY
Publisher Policy
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Terms of use
Metadata
Show full item recordAbstract
Data quality is a critical problem in modern databases. Data entry forms present the first and arguably best opportunity for detecting and mitigating errors, but there has been little research into automatic methods for improving data quality at entry time. In this paper, we propose USHER, an end-to-end system for form design, entry, and data quality assurance. Using previous form submissions, USHER learns a probabilistic model over the questions of the form. USHER then applies this model at every step of the data entry process to improve data quality. Before entry, it induces a form layout that captures the most important data values of a form instance as quickly as possible. During entry, it dynamically adapts the form to the values being entered, and enables real-time feedback to guide the data enterer toward their intended values. After entry, it re-asks questions that it deems likely to have been entered incorrectly. We evaluate all three components of USHER using two real-world data sets. Our results demonstrate that each component has the potential to improve data quality considerably, at a reduced cost when compared to current practice.
Date issued
2010-03Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence LaboratoryJournal
2010 IEEE 26th International Conference on Data Engineering (ICDE)
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Chen, Kuang et al. “USHER: Improving Data Quality with Dynamic Forms.” IEEE, 2010. 321–332. Web. 4 Apr. 2012. © 2010 Institute of Electrical and Electronics Engineers
Version: Final published version
Other identifiers
INSPEC Accession Number: 11258785
ISBN
978-1-4244-5444-0
978-1-4244-5445-7