BESDUI: A Benchmark for End-User Structured Data User Interfaces
Name
Karger_besdui.pdf
Size
811.36 KB
Format
Adobe PDF
Checksum (MD5)
e17295457f32039761ab83555ed614b3
Author(s)
García, Roberto
Gil, Rosa
Gimeno, Juan Manuel
Karger, David R
Bakke, Eirik
Date Issued
September 2016
Journal
The Semantic Web – ISWC 2016
Publisher
Springer-Verlag
Citation
García, Roberto, Rosa Gil, Juan Manuel Gimeno, Eirik Bakke, and David R. Karger. “BESDUI: A Benchmark for End-User Structured Data User Interfaces.” The Semantic Web – ISWC 2016 (2016): 65–79.
Version
Author's final manuscript
Abstract
The Semantic Web Community has invested significant research efforts in developing systems for Semantic Web search and exploration. But while it has been easy to assess the systems’ computational efficiency, it has been much harder to assess how well different semantic systems’ user interfaces help their users. In this article, we propose and demonstrate the use of a benchmark for evaluating such user interfaces, similar to the TREC benchmark for evaluating traditional search engines. Our benchmark includes a set of typical user tasks and a well-defined procedure for assigning a measure of performance on those tasks to a semantic system. We demonstrate its application to two such system, Virtuoso and Rhizomer. We intend for this work to initiate a community conversation that will lead to a generally accepted framework for comparing systems and for measuring, and thus encouraging, progress towards better semantic search and exploration tools.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1007/978-3-319-46547-0_8
