Knee osteoarthritis (OA) is a popular and progressive degenerate joint disease and require a predictor of risk at the primary stage to predict drug treatment and propose an early intervention. The current methods of deep learning are not sufficient enough to deal with integrating the heterogeneous modality component, modeling of irregular temporal follow ups, and capture of the fine grained variations of pathological types. In order to address such limitations, this paper suggests a new multimodal approach named, RAD-OAEnsemble which introduces three main innovations. First, a novel Cross Bi-modal Heterogeneous Graph Fusion Network (CBHGF-Net) is introduced for the multi-scale semantic fusion of Radiographs and Electronic Health Records (EHRs). Second, a Modified DenseNet with Multi-scale Attention Criss-Cross Blocks (MACC-Blocks) is presented to extract the anatomical features of knee OA patterns by utilizing dilated convolution, criss-cross attention, residual attention gating. Third, a Dual-Stream Tranfo-Convo (DTC) Deep Temporal Embedding module is proposed that consists of a Time-Warped Convolutional Blocks and a Temporal Decay Encoded Informer for the knee OA risk prediction. The suggested approach delivered better outcomes with accuracy of 99.275%, precision of 98.175%, specificity of 99.165%, sensitivity of 98.95%, and F1-score of 98.175% in having considerably a low rate of false positives (1.875%) and false negatives (2.175%). The findings support the relevance of the suggested framework in providing resilient, time-sensitive, and explainable OA progression predictions by multimodal combination and high-fidelity feature learning.
People of all demographics are impacted by mental illness, which has become a widespread and international health problem. Effective treatment and support for mental illnesses depend on early discovery and precise diagnosis. Notably, delayed diagnosis may lead to suicidal thoughts, destructive behaviour, and death. Manual diagnosis is time-consuming and laborious. With the advent of AI, this research aims to develop a novel mental health disorder detection network with the objective of maximum accuracy and early discovery. For this reason, this study presents a novel framework for the early detection of mental illness disorders using a multi-modal approach combining speech and behavioral data. This framework preprocesses and analyzes two distinct datasets to handle missing values, normalize data, and eliminate outliers. The proposed NeuroVibeNet combines Improved Random Forest (IRF) and Light Gradient-Boosting Machine (LightGBM) for behavioral data and Hybrid Support Vector Machine (SVM) and K-Nearest Neighbors (KNN) for voice data. Finally, a weighted voting mechanism is applied to consolidate predictions. The proposed model achieves robust performance and a competitive accuracy of 99.06% in distinguishing normal and pathological conditions. This framework validates the feasibility of multi-modal data integration for reliable and early mental illness detection.
mental disorder detectionearly diagnosisspeech analysisbehavioral data
Brain Research Bulletin · مجلد 233 · 111645-111645
Epilepsy is a critical neurological disorder that requires accurate and privacy-preserving diagnostic solutions to enable early detection and effective management. However, existing approaches face key challenges, including reliance on centralized data, poor generalizability across modalities, suboptimal feature extraction, and vulnerability to noise. To address these issues, we propose MultiEpilepsyNet, a novel multimodal seizure detection framework that integrates federated learning with hybrid deep learning models. At its core, the system introduces SeizureFed-Net, a federated architecture that enables collaborative learning from EEG and MRI data while safeguarding patient privacy. For detection, we design SeizureShieldNet, a hybrid model that fuses the temporal learning capabilities of BBIDNet (Boosted BiLSTM Intrusion Detector Network) with the adaptive decision-making of FD-TMS (Fuzzy-DQN Threat Mitigation System) under uncertainty. To further enhance model efficiency, a Jackal-Wolf Hybrid Optimizer (JWHO)-a novel combination of Golden Jackal Optimization and Grey Wolf Optimizer-is employed for optimal feature subset selection. On the imaging side, MRI preprocessing is improved through EpiSkullNet+ +, a modified 3D UNet+ + architecture tailored for precise brain segmentation. Extensive experiments on two benchmark datasets demonstrate the superiority of our approach, achieving 99.36 % accuracy on the CHB-MIT EEG dataset and 99.38 % accuracy on an epilepsy MRI dataset. Beyond accuracy, MultiEpilepsyNet demonstrates improved robustness to missing modalities, reduced training overhead via federated aggregation, and enhanced privacy preservation compared to centralized deep learning models, thereby addressing critical barriers in practical clinical deployment. These outcomes highlight the effectiveness, scalability, and real-world clinical potential of the proposed framework for epilepsy diagnosis and management.
Advanced Health Science and Technology Journal · مجلد 1 (2) · 92-99
Abstract Background: Epilepsy remains one of the most prevalent neurological disorders worldwide, characterized by recurrent seizures resulting from abnormal electrical brain activity. Traditional diagnostic methods, such as electroencephalography (EEG) and magnetic resonance imaging (MRI), although widely used, often fail to provide sufficient accuracy when applied in isolation due to their inherent limitations in temporal or spatial resolution. These challenges highlight the need for integrated analytical approaches capable of leveraging complementary modalities for improved diagnostic precision. Objectives: This study aims to address the limitations of single-modality diagnostic techniques by proposing a multimodal deep learning framework that integrates EEG and MRI data to enhance the accuracy of epilepsy detection. The objectives include preprocessing EEG signals to remove artifacts, segmenting MRI scans for structural feature extraction, employing CNNs to model EEG spatio-temporal dependencies, using ViTs to capture hierarchical MRI features, and integrating these representations through a cross-attention fusion mechanism for effective supervised classification. Method: The methodology involves preprocessing EEG signals to eliminate artifacts and ensure clean temporal representation, along with MRI scan segmentation to extract structural information. Convolutional neural networks (CNNs) were used to model spatio-temporal patterns within EEG signals, while vision transformers (ViTs) extracted spatially hierarchical features from MRI data. A cross-attention fusion mechanism was designed to integrate these complementary modalities, and a supervised classifier performed the final prediction. Model training and evaluation were carried out using a high-performance computing setup with GPU acceleration to efficiently handle multimodal data. Results: Experimental results demonstrated that the proposed multimodal deep learning model significantly outperformed state-of-the-art pretrained CNN and ViT baselines across major evaluation metrics, including accuracy, precision, recall, F1-score, and Matthews correlation coefficient. The confusion matrix further confirmed robust differentiation between normal and epileptic classes, emphasizing the reliability of the proposed framework for accurate clinical decision-making. Conclusion: The findings of this study indicate that integrating EEG and MRI data through a multimodal fusion framework provides a substantial improvement in epilepsy detection compared to single-modality approaches. The results highlight the importance of combining complementary temporal and structural information to achieve reliable diagnostic performance. This work contributes to advancing early detection, reducing diagnostic errors, and supporting timely treatment strategies, reinforcing the value of multimodal deep learning approaches in personalized healthcare.