Measuring Data Believability: A Provenance Approach
Name
esd-wp-2008-04.pdf
Size
232.57 KB
Format
Adobe PDF
Checksum (MD5)
099890c940fc4d78cd9935ac113533c0
Author(s)
Pratt, Nicolas
Madnick, Stuart E.
Date Issued
January 2008
Publisher
Massachusetts Institute of Technology. Engineering Systems Division
Series/Report no.
ESD Working Papers;ESD-WP-2008-04
Abstract
Data quality is crucial for operational efficiency and sound decision making. This paper focuses on believability, a major aspect of quality, measured along three dimensions: trustworthiness, reasonableness, and temporality. We ground our approach on provenance, i.e. the origin and subsequent processing history of data. We present our provenance model and our approach for computing believability based on provenance metadata. The approach is structured into three increasingly complex building blocks: (1) definition of metrics for assessing the believability of data sources, (2) definition of metrics for assessing the believability of data resulting from one process run and (3) assessment of believability based on all the sources and processing history of data. We illustrate our approach with a scenario based on Internet data. To our knowledge, this is the first work to develop a precise approach to measuring data believability and making explicit use of provenance-based measurements.
Persistent DSpace Link
