Interpretable Multimodal EEG-ECG Framework for Neonatal Seizure Prediction and Patient-Adaptive Transfer Learning

arXiv:2511.14110 · eess.SP, cs.LG · Submitted 2025-11-18 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Today's paper: "Interpretable Multimodal EEG-ECG Framework for Neonatal Seizure Prediction and Patient-Adaptive Transfer Learning".

Jane: The gist Neonates are highly susceptible to seizures, often leading to short or long-term neurological impairments,

Tom: First, who's behind it and why it matters.

Paper summary: Tom: So wrapping up "Interpretable Multimodal EEG-ECG Framework for Neonatal Seizure Prediction and Patient-Adaptive Transfer Learning," we're looking at a patient-independent convolutional neural network model that predicts seizures thirty minutes before onset, with high accuracy metrics like ninety-seven point five two percent on the Helsinki dataset >

Jane: The authors developed this framework by combining a reduced-montage EEG with an ECG signal, using mel-frequency cepstral coefficient matrices as input, and they used an interpretable CNN architecture with attention mechanisms to find preictal states >

Lu: What's the big implication here for the field? They're showing that deep learning can be used to create tools that are not just accurate but also explainable in a medical context, which moves it closer to being usable in critical care environments >

Meng: The patient-independent nature combined with transfer learning is what makes this approach applicable where personalized models are too difficult to train due to the data constraints in neonates >

Lalam: This work shows that even with high inter-subject variability, a well-designed AI framework can learn robust features from multimodal data like EEG and ECG signals >

Tom: So for someone listening who doesn't read the paper, this means we have a potential tool that could give doctors an early warning sign, based on what looks like the electrical activity in the baby's brain, allowing for timely clinical interventions >

Conclusion: Tom: So we've been looking at this paper on neonatal seizure prediction using EEG and ECG data, right? And the title itself is pretty descriptive, "Interpretable Multimodal EEG-ECG Framework for Neonatal Seizure Prediction and Patient-Adaptive Transfer Learning."

Jane: Yeah, that title tells you a lot. It suggests they're not just building a prediction tool but also focusing on making sure you can actually understand *why* the tool is making its prediction.

Lu: Exactly. The "Interpretable" part is huge for medical AI because doctors need to trust what the computer says before they act on it in a hospital setting.

Meng: I'm thinking about that interpretability—how does it map those brain signals back onto something a doctor can see, like where the seizure might start? That's the practical hurdle.

Lalam: From an AI vision standpoint, this whole setup is interesting because they’re using transfer learning and fine-tuning with just a few samples. It shows that you don't need millions of neonate recordings to build something powerful that works for a specific baby.

Tom: That patient-independent part is what I find really compelling for the world of neonatal intensive care, because getting personalized models for every single baby is just not feasible right now.

Jane: So, what does this actually mean if it works well? The summary points to predicting seizures about thirty minutes before they happen. That gives clinicians a window to prepare and intervene.

Lu: Thirty minutes is a significant lead time in critical care, especially since the authors showed strong generalization by fine-tuning on very short signal segments from unseen subjects.

Meng: That's the engineer’s angle—if it can generalize well with just a few samples, it means the deployment pipeline for these systems doesn't have to be impossibly complex every time they get a new patient.

Lalam: It also touches on how AI can help improve culture in healthcare by providing this kind of early warning system that everyone understands.

Tom: So we've seen the tech and the results, but what does this whole framework actually mean for the future of treating neonatal seizures? We need to talk about those implications next.

Sithmini Ranasingha, Agasthi Haputhanthri, Hansa Marasinghe, Wickramasinghe, Kithmin Wickremasinghe, Jithangi Wanigasinghe, Chamira U. S. Edussooriya Senior Member, IEEE, and Joshua P. Kulasingham

Department of Electronic and Telecommunication Engineering, University of Moratuwa, Sri Lanka · Department of Biomedical Engineering, University of Melbourne, Australia · Department of Electrical and Computer Engineering, University of British Columbia, Canada · Department of Pediatrics, Faculty of Medicine, University of Colombo

eess.SP, cs.LG

Submitted: 2025-11-18

Updated: 2026-10-11

Comments: 7 pages, 4 figures

Code: https://github.com/Sithminii/BraiNeoCare

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 86/100

The gist: The gist Neonates are highly susceptible to seizures, often leading to short or long-term neurological impairments, and this study proposes a patient-independent convolutional neural network-based

Key concepts

Reduced-Montage EEG
This is a simplified way of recording the brain's electrical activity using fewer electrodes than a full scalp EEG. It is used in neonates because it reduces discomfort and simplifies clinical setup while still providing enough data for accurate seizure prediction.
Mel-Frequency Cepstral Coefficients (MFCC)
These are mathematical features derived from the raw EEG and ECG signals. The model converts these signals into a compact matrix of features that capture the essential characteristics of the brain activity relevant to identifying seizure states.
Squeeze-and-Excitation (SE) Attention
This is a mechanism integrated into the CNN to help the model focus on the most important parts of its input data. It works by 'squeezing' information down and then 'exciting' it, allowing the network to prioritize specific EEG channels that are most indicative of an impending seizure.

Terminology

Summary

The gist Neonates are highly susceptible to seizures, often leading to short or long-term neurological impairments, and this study proposes a patient-independent convolutional neural network-based model for early prediction of neonatal seizures by distinguishing between interictal and preictal states of the EEG The overall results demonstrate the model’s potential for minimally supervised deployment in neonatal intensive care units, enabling timely and reliable prediction of neonatal seizures, while demonstrating strong generalization capability across unseen subjects through transfer learning.

Model Features and Inputs

The proposed model utilizes a reduced-montage EEG for minimal clinical intrusiveness, which eliminates the need for extensive scalp coverage in neonates, reducing discomfort and simplifying clinical setup without degrading performance. The input to the model is a multichannel mel-frequency cepstral coefficient matrix derived from EEG and ECG signals. This MFCC computation process comprises five key steps, including segmenting the signal into overlapping time frames and applying a Hamming window to minimize spectral leakage. The resulting MFCC feature matrices had dimensions of (19, 20, 11), where 19 corresponds to the total number of EEG and ECG channels.

Model Architecture

The proposed model architecture comprises three primary components: a CNN encoder, a channel attention mechanism, and a classifier for seizure prediction. The input to the model is a multichannel MFCC matrix derived from EEG and ECG signals. The CNN encoder is composed of three sequential 2D convolutional blocks, each including a 2D convolutional layer followed by batch normalization, a ReLU activation, dropout, and max-pooling. To enhance the model’s ability to focus on the most informative feature channels, a squeeze-and-excitation (SE) attention mechanism is integrated. The SE block consists of three main stages: Squeeze, Excitation, and Recalibration. The final component is a fully connected classifier that produces a probability score reflecting the likelihood of the input segment corresponding to a preictal state.

Training and Evaluation

To assess robustness, 10-fold cross-validation was employed, using binary cross-entropy loss function and optimized with the Adam optimizer. To address class imbalance in the datasets, class weights were incorporated into the loss function. The model performance was monitored using metrics including accuracy, sensitivity, specificity, and F1-score. Furthermore, a leave-one-patient-out (LOPO) evaluation was conducted to examine generalization capability. To address high intersubject variability in EEG patterns during LOPO, a transfer learning approach was adopted where the model is initially trained on data from all available neonates except the target subject and then finetuned using a short-duration signal segment comprising both interictal and preictal samples from the held-out neonate.

Interpretability

To improve interpretability, SHapley Additive exPlanations (SHAP) was used to interpret the model. This process involves constructing a test set comprising the first six preictal segments from the beginning of the preictal period and randomly selecting six interictal segments from each neonate. The resulting channel-wise SHAP values for each neonate were obtained using a formula that calculates importance based on mean and standard deviation of the 3D SHAP matrix. These processed channel importances are mapped onto the scalp electrode map to provide an approximate localization of seizure focus.

Results Summary

The proposed model achieved an average accuracy of 97.52%, sensitivity of 98.31%, specificity of 96.39%, and F1-score of 97.95% on the Helsinki neonatal EEG dataset. The inclusion of ECG alongside EEG improved the F1-score by 1.42%, while the incorporation of an attention mechanism yielded an additional 0.5% improvement. The model demonstrated strong performance, achieving over 96% and 95% in accuracy, sensitivity, specificity, and F1-score on the Helsinki and Siena datasets respectively. The ability to achieve strong performance with finetuning on short-duration data is particularly relevant in clinical contexts.

The study concludes that a lightweight CNN-based model integrated with attention mechanisms can predict neonatal seizures 30 minutes before onset, enabling timely clinical interventions. By finetuning with only a few samples, our method can generalize well to new subjects, demonstrating its applicability in realworld clinical settings. Our approach incorporates explainable AI techniques, generating scalp plots based on model predictions to help clinicians understand and localize upcoming seizures, enabling timely interventions and improved neonatal care. The overall results provide a strong foundation for future studies and highlight the potential of AI-driven seizure prediction to improve neonatal outcomes.

The gist Neonates are highly susceptible to seizures, often leading to short or long-term neurological impairments, and this study proposes a patient-independent convolutional neural network-based model for early prediction of neonatal seizures by distinguishing between interictal and preictal states of the EEG.

Improvements for AI systems

  1. The model can achieve accurate seizure prediction up to 30 minutes before onset by utilizing a reduced-montage EEG for minimal clinical intrusiveness, which simplifies setup while retaining performance.

  2. The system can be made more robust and efficient by employing a lightweight, multi-modal, and interpretable model, with an attention mechanism for enhanced feature relevance, as the authors state this results in a model with only about 70k parameters.

  3. The prediction accuracy can be further enhanced by integrating complementary physiological data; specifically, the inclusion of ECG signals improved the F1-score by 1.42%, and incorporating an attention mechanism yielded an additional 0.5% improvement.

  4. The system's clinical utility can be significantly increased through enhanced transparency, as it incorporates SHapley Additive exPlanations (SHAP) as an explainable artificial intelligence method to interpret the model and provided localization of seizure focus using scalp plots.

  5. The model's generalization capability across unseen subjects can be improved by utilizing a transfer learning approach, where the pre-trained model is finetuned using a short-duration signal segment comprising both interictal and preictal samples from the held-out neonate.

Sources

Related papers