Automatic Estimation of Transcription Accuracy and Difficulty
Name
roy-vosoughi-roy_interspeech2010.pdf
Size
1.69 MB
Format
Adobe PDF
Checksum (MD5)
5d16c6d208163bb981bc2b29dfd8a463
Author(s)
Vosoughi, Soroush
Roy, Brandon C.
Roy, Deb K
Date Issued
September 2010
Journal
Proceedings of Interspeech 2010
Publisher
International Speech Communication Association
Citation
Roy, Brandon C. / Vosoughi, Soroush / Roy, Deb (2010): "Automatic estimation of transcription accuracy and difficulty", In INTERSPEECH-2010, 1902-1905.
Version
Author's final manuscript
Abstract
Managing a large-scale speech transcription task with a team of
human transcribers requires effective quality control and workload
distribution. As it becomes easier and cheaper to collect
massive audio corpora the problem is magnified. Relying on
expert review or transcribing all speech multiple times is impractical.
Furthermore, speech that is difficult to transcribe may
be better handled by a more experienced transcriber or skipped
entirely.
We present a fully automatic system to address these issues.
First, we use the system to estimate transcription accuracy from
a a single transcript and show that it correlates well with intertranscriber
agreement. Second, we use the system to estimate
the transcription “difficulty” of a speech segment and show that
it is strongly correlated with transcriber effort. This system
can help a transcription manager determine when speech segments
may require review, track transcriber performance, and
efficiently manage the transcription process.
MIT Department
Program in Media Arts and Sciences (Massachusetts Institute of Technology)
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike 3.0
Persistent DSpace Link
DOI of Published Version
http://www.isca-speech.org/archive/interspeech_2010/i10_1902.html
