High fidelity medical image-to-image translation
Author(s)
Wang, Clinton,(Clinton J.)
Download1192966757-MIT.pdf (8.462Mb)
Other Contributors
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.
Advisor
Polina Golland.
Terms of use
Metadata
Show full item recordAbstract
Despite much recent progress in image-to-image translation, it remains challenging to apply such techniques to medical images. We develop a novel parameterization of conditional generative adversarial networks that achieves high image fidelity when trained to transform magnetic resonance images (MRIs) conditioned on a patient's age and disease severity. The spatial-intensity transform generative adversarial network (SIT-GAN) constrains the generator to a smooth spatial transform composed with sparse intensity changes. This technique improves image quality and robustness to artifacts, and generalizes to different scanners. Our model achieves state of the art predictions of longitudinal brain MRIs without supervised training on paired scans. We also demonstrate SIT-GAN on a large clinical image dataset of stroke patients, where it captures associations between ventricle expansion and aging, as well as between white matter hyper intensities and stroke severity. Additionally, SIT-GAN provides a disentangled view of anatomical and textural changes with each transformation, making it easier to interpret the model's predictions in terms of physiological phenomena. As conditional generative models become increasingly versatile tools for data exploration, visualization and forecasting, such techniques for improving robustness are critical for their translation to clinical settings.
Description
Thesis: S.M. in Computer Science and Engineering, Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, May, 2020 Cataloged from the official PDF of thesis. Includes bibliographical references (pages 43-49).
Date issued
2020Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer SciencePublisher
Massachusetts Institute of Technology
Keywords
Electrical Engineering and Computer Science.