Integrative Multimodal Analysis Using Electroencephalography and Structural Magnetic Resonance Imaging Data for Epileptic Disorder Detection
Advanced Health Science and Technology Journal · مج 1 (2) · 92-99 · 2025
الملخّص
Abstract Background: Epilepsy remains one of the most prevalent neurological disorders worldwide, characterized by recurrent seizures resulting from abnormal electrical brain activity. Traditional diagnostic methods, such as electroencephalography (EEG) and magnetic resonance imaging (MRI), although widely used, often fail to provide sufficient accuracy when applied in isolation due to their inherent limitations in temporal or spatial resolution. These challenges highlight the need for integrated analytical approaches capable of leveraging complementary modalities for improved diagnostic precision. Objectives: This study aims to address the limitations of single-modality diagnostic techniques by proposing a multimodal deep learning framework that integrates EEG and MRI data to enhance the accuracy of epilepsy detection. The objectives include preprocessing EEG signals to remove artifacts, segmenting MRI scans for structural feature extraction, employing CNNs to model EEG spatio-temporal dependencies, using ViTs to capture hierarchical MRI features, and integrating these representations through a cross-attention fusion mechanism for effective supervised classification. Method: The methodology involves preprocessing EEG signals to eliminate artifacts and ensure clean temporal representation, along with MRI scan segmentation to extract structural information. Convolutional neural networks (CNNs) were used to model spatio-temporal patterns within EEG signals, while vision transformers (ViTs) extracted spatially hierarchical features from MRI data. A cross-attention fusion mechanism was designed to integrate these complementary modalities, and a supervised classifier performed the final prediction. Model training and evaluation were carried out using a high-performance computing setup with GPU acceleration to efficiently handle multimodal data. Results: Experimental results demonstrated that the proposed multimodal deep learning model significantly outperformed state-of-the-art pretrained CNN and ViT baselines across major evaluation metrics, including accuracy, precision, recall, F1-score, and Matthews correlation coefficient. The confusion matrix further confirmed robust differentiation between normal and epileptic classes, emphasizing the reliability of the proposed framework for accurate clinical decision-making. Conclusion: The findings of this study indicate that integrating EEG and MRI data through a multimodal fusion framework provides a substantial improvement in epilepsy detection compared to single-modality approaches. The results highlight the importance of combining complementary temporal and structural information to achieve reliable diagnostic performance. This work contributes to advancing early detection, reducing diagnostic errors, and supporting timely treatment strategies, reinforcing the value of multimodal deep learning approaches in personalized healthcare.
التفاصيل
- المجلة
- Advanced Health Science and Technology Journal
- الناشر
- —
- المجلد
- 1
- العدد
- 2
- الصفحات
- 92-99
- الترقيم الدولي ISSN
- 3117-5422
- السنة
- 2025
- اللغة
- en
- الترخيص
- cc-by-nc-nd
- الوصول المفتوح
- hybrid
- الاستشهادات
- 0
- المصدر
- scopus
الكلمات المفتاحية
الموضوعات
EEG and Brain-Computer Interfaces (Neuroscience) · Epilepsy research and treatment (Medicine) · Machine Learning in Healthcare (Computer Science)
استشهد بهذا
Alatwi, K. A., Alshaikh, A. A., Jahlan, A. A., Alhugbani, M. T., Dutta, A. K. (2025). Integrative Multimodal Analysis Using Electroencephalography and Structural Magnetic Resonance Imaging Data for Epileptic Disorder Detection. Advanced Health Science and Technology Journal, 1(2), 92-99. https://doi.org/10.4103/ahstj.ahstj_20_25
Alatwi, K. A., Alshaikh, A. A., Jahlan, A. A., Alhugbani, M. T., Dutta, A. K. 2025, 'Integrative Multimodal Analysis Using Electroencephalography and Structural Magnetic Resonance Imaging Data for Epileptic Disorder Detection', Advanced Health Science and Technology Journal, vol. 1(2), 92-99. Available at: https://doi.org/10.4103/ahstj.ahstj_20_25
Alatwi KA, Alshaikh AA, Jahlan AA, Alhugbani MT, Dutta AK. Integrative Multimodal Analysis Using Electroencephalography and Structural Magnetic Resonance Imaging Data for Epileptic Disorder Detection. Advanced Health Science and Technology Journal. 2025;1(2), 92-99.
@article{alatwi2025672,
title = {Integrative Multimodal Analysis Using Electroencephalography and Structural Magnetic Resonance Imaging Data for Epileptic Disorder Detection},
author = {Khaled Alyan Alatwi and Ahmad Amin Alshaikh and Ahmad Abdullah Jahlan and Mohammad Turki Alhugbani and Ashit Kumar Dutta},
year = {2025},
journal = {Advanced Health Science and Technology Journal},
volume = {1},
number = {2},
pages = {92-99},
doi = {10.4103/ahstj.ahstj_20_25},
url = {https://doi.org/10.4103/ahstj.ahstj_20_25}
}TY - JOUR AU - Khaled Alyan Alatwi AU - Ahmad Amin Alshaikh AU - Ahmad Abdullah Jahlan AU - Mohammad Turki Alhugbani AU - Ashit Kumar Dutta TI - Integrative Multimodal Analysis Using Electroencephalography and Structural Magnetic Resonance Imaging Data for Epileptic Disorder Detection PY - 2025 JO - Advanced Health Science and Technology Journal VL - 1 IS - 2 SP - 92-99 DO - 10.4103/ahstj.ahstj_20_25 UR - https://doi.org/10.4103/ahstj.ahstj_20_25 ER -
