Almaarefa University
The authoritative source for research information and outputs is Elsevier Scopus, with researcher profile verification from the Deanship of Scientific Research.

المخرجات

Research outputs

Articles, reviews, conference papers and book chapters, indexed by DOI and linked to University researchers.

2 output Results for «multimodal analysis»

ArticleOpen access20262citation· Semantic Scholar

An AI-driven multimodal developmental disability detection and intervention framework using enhanced speech and behavioral analysis with BioNeuroFusionNet classification

Journal Of Big Data · vol. 13 (1)

Abstract Effective intervention and detection of developmental disabilities (DDs) should be carried out early and accurately. This paper discusses a novel AI-based approach for detecting DDs precisely, by incorporating both speech and behavioral data in a unique manner. The new architecture comprises several key stages, with innovations attributed to the system: Enhanced Gaussian-Based Noise Filtering (EGNF) is used to enhance speech; Conv-BiLSTM and Transformer Embeddings for performing strong feature extraction from speech and behavior; Harmony-ReliefF Optimization (HRO) for feature selection, and BioNeuroFusionNet (BNFN) as a novel classification network integrating IndRNN and MnasNet, with GNA selected as the class superiors. The Harmony-ReliefF Optimization (HRO) strategy combines the exploration capabilities of the Harmony Search Algorithm (HSA) with the feature ranking ability of ReliefF for optimizing the feature space. The features selected and optimally extracted are then fed into the novel BioNeuroFusionNet (BNFN) intended for final classification. The BNFN is another significant contribution of this work, where Independently Recurrent Neural Networks (IndRNN) are incorporated for fast processing of sequential data set and MnasNet (MN) for extracting high-level abstract features. The experimental result indicates that this integrated architecture works effectively with high accuracy (0.98942 for voice; 0.99632 for behavior) and very high scores in precision, recall, specificity, and other relevant metrics. Indeed, these results indicate that the system proposed in this work represents a considerable improvement in the area of early diagnosis and intervention of developmental disorders.

multimodal analysisspeech analysisbehavior analysisearly diagnosis
ArticleOpen (repository)2025

Integrative Multimodal Analysis Using Electroencephalography and Structural Magnetic Resonance Imaging Data for Epileptic Disorder Detection

Advanced Health Science and Technology Journal · vol. 1 (2) · 92-99

Abstract Background: Epilepsy remains one of the most prevalent neurological disorders worldwide, characterized by recurrent seizures resulting from abnormal electrical brain activity. Traditional diagnostic methods, such as electroencephalography (EEG) and magnetic resonance imaging (MRI), although widely used, often fail to provide sufficient accuracy when applied in isolation due to their inherent limitations in temporal or spatial resolution. These challenges highlight the need for integrated analytical approaches capable of leveraging complementary modalities for improved diagnostic precision. Objectives: This study aims to address the limitations of single-modality diagnostic techniques by proposing a multimodal deep learning framework that integrates EEG and MRI data to enhance the accuracy of epilepsy detection. The objectives include preprocessing EEG signals to remove artifacts, segmenting MRI scans for structural feature extraction, employing CNNs to model EEG spatio-temporal dependencies, using ViTs to capture hierarchical MRI features, and integrating these representations through a cross-attention fusion mechanism for effective supervised classification. Method: The methodology involves preprocessing EEG signals to eliminate artifacts and ensure clean temporal representation, along with MRI scan segmentation to extract structural information. Convolutional neural networks (CNNs) were used to model spatio-temporal patterns within EEG signals, while vision transformers (ViTs) extracted spatially hierarchical features from MRI data. A cross-attention fusion mechanism was designed to integrate these complementary modalities, and a supervised classifier performed the final prediction. Model training and evaluation were carried out using a high-performance computing setup with GPU acceleration to efficiently handle multimodal data. Results: Experimental results demonstrated that the proposed multimodal deep learning model significantly outperformed state-of-the-art pretrained CNN and ViT baselines across major evaluation metrics, including accuracy, precision, recall, F1-score, and Matthews correlation coefficient. The confusion matrix further confirmed robust differentiation between normal and epileptic classes, emphasizing the reliability of the proposed framework for accurate clinical decision-making. Conclusion: The findings of this study indicate that integrating EEG and MRI data through a multimodal fusion framework provides a substantial improvement in epilepsy detection compared to single-modality approaches. The results highlight the importance of combining complementary temporal and structural information to achieve reliable diagnostic performance. This work contributes to advancing early detection, reducing diagnostic errors, and supporting timely treatment strategies, reinforcing the value of multimodal deep learning approaches in personalized healthcare.

seizure detectionmultimodal fusionEEGstructural MRI