A Novel Prediction Model for Multimodal Medical Data Based on Graph Neural Networks
Name
make-07-00092.pdf
Size
1.41 MB
Format
Adobe PDF
Checksum (MD5)
0e171547ecbfceda6c7592f036d0a090
Author(s)
Zhang, Lifeng
Li, Teng
Cui, Hongyan
Zhang, Quan
Jiang, Zijie
Li, Jiadong
Welsch, Roy E.
Jia, Zhongwei
Date Issued
September 1, 2025
Publisher
Multidisciplinary Digital Publishing Institute
Citation
Zhang, L.; Li, T.; Cui, H.; Zhang, Q.; Jiang, Z.; Li, J.; Welsch, R.E.; Jia, Z. A Novel Prediction Model for Multimodal Medical Data Based on Graph Neural Networks. Mach. Learn. Knowl. Extr. 2025, 7, 92.
Version
Final published version
Abstract
Multimodal medical data provides a wide and real basis for disease diagnosis. Computer-aided diagnosis (CAD) powered by artificial intelligence (AI) is becoming increasingly prominent in disease diagnosis. CAD for multimodal medical data requires addressing the issues of data fusion and prediction. Traditionally, the prediction performance of CAD models has not been good enough due to the complicated dimensionality reduction. Therefore, this paper proposes a fusion and prediction model—EPGC—for multimodal medical data based on graph neural networks. Firstly, we select features from unstructured multimodal medical data and quantify them. Then, we transform the multimodal medical data into a graph data structure by establishing each patient as a node, and establishing edges based on the similarity of features between the patients. Normalization of data is also essential in this process. Finally, we build a node prediction model based on graph neural networks and predict the node classification, which predicts the patients’ diseases. The model is validated on two publicly available datasets of heart diseases. Compared to the existing models that typically involve dimensionality reduction, classification, or the establishment of complex deep learning networks, the proposed model achieves outstanding results with the experimental dataset. This demonstrates that the fusion and diagnosis of multimodal data can be effectively achieved without dimension reduction or intricate deep learning networks. We take pride in exploring unstructured multimodal medical data using deep learning and hope to make breakthroughs in various fields.
MIT Department
Sloan School of Management
Statistics and Data Science Center (Massachusetts Institute of Technology)
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.3390/make7030092
