Learning to Segment Unseen Tasks In-Context
Name
butoi-vbutoi-sm-eecs-2024-thesis.pdf
Description
Thesis PDF
Size
9.28 MB
Format
Adobe PDF
Checksum (MD5)
2cf9ad5b041c3003d368f3f88435d74a
Author(s)
Butoi, Victor Ion
Advisor(s)
Guttag, John V.
Dalca, Adrian V.
Date Issued
May 2024
Publisher
Massachusetts Institute of Technology
Abstract
While deep learning models have become the predominant method for medical image segmentation, they are typically incapable of generalizing to new segmentation tasks---involving new anatomies, image modalities, or labels. For a new segmentation task, researchers will often have to prepare new task-specific models. This process is time-consuming and poses a substantial barrier for clinical researchers who often lack the resources and expertise to train neural networks.
We present UniverSeg, an in-context learning method for solving unseen medical segmentation tasks. Given a new image to segment, and a set of image-label pairs that define the task, UniverSeg can produce accurate segmentation predictions with no additional training. We demonstrate that UniverSeg substantially outperforms existing methods in solving unseen segmentation tasks, and thoroughly analyze important aspects of our proposed data, training, and inference paradigms.
MIT Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
Copyright retained by author(s)
Persistent DSpace Link
