Repository logo
Log in(current)
Repository logoMIT Open ScholarshipDSpace@MIT
  1. Home
  2. MIT Open Access Articles
  3. MIT Open Access Articles
  4. IDE: A System for Iterative Mislabel Detection

IDE: A System for Iterative Mislabel Detection

Thumbnail Image
Download
Name

3626246.3654737.pdf

Size

2.3 MB

Format

Adobe PDF

Checksum (MD5)

636acc17d4505b3a160141a73b40c2aa

Download all files submitted through automated deposit
3626246.3654737.zip (2.21 MB)
Author(s)
Deng, Yuhao
•
Deng, Qiyan
•
Chai, Chengliang
•
Cao, Lei
•
Tang, Nan
•
Fan, Ju
•
Wang, Jiayi
•
Yuan, Ye
•
Wang, Guoren
Date Issued
June 9, 2024
Publisher
ACM|Companion of the 2024 International Conference on Management of Data
Citation
Deng, Yuhao, Deng, Qiyan, Chai, Chengliang, Cao, Lei, Tang, Nan et al. 2024. "IDE: A System for Iterative Mislabel Detection."
Version
Final published version
Abstract
While machine learning techniques, especially deep neural networks, have shown remarkable success in various applications, their performance is adversely affected by label errors in training data. Acquiring high-quality annotated data is both costly and time-consuming in real-world scenarios, requiring extensive human annotation and verification. Consequently, many industry-applied models are trained over data containing substantial noise, significantly degrading the performance of these models. To address this critical issue, we demonstrate IDE, a novel system that iteratively detects mislabeled instances and repairs the wrong labels. Specifically, IDE leverages the early loss observation and influence-based verification to iteratively identify mislabeled instances. When the mislabeled instances are obtained in each iteration, IDE will repair their labels to enhance detection accuracy for subsequent iterations. The framework automatically determines the termination point when the early loss is no longer effective. For uncertain instances, it generates pseudo labels to train a binary classification model, leveraging the model's generalization ability to make the final decision. With a real-life scenario, we demonstrate that IDE produces high-quality training data by effective mislabel detection and repair.
Description
SIGMOD-Companion ’24, June 09–15, 2024, Santiago, AA, Chile
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Persistent DSpace Link
https://hdl.handle.net/1721.1/155776
DOI of Published Version
https://doi.org/10.1145/3626246.3654737
Repository logo
PrivacyPermissionsAccessibilityContact us
Repository logo
Notify us about copyright concerns.