ArrythML: An Autoencoder-Based TinyML Approach for On-Device Arrhythmia Detection on Resource-Constrained Embedded Systems
summary
The gist
Our work presents a method for ECG segmentation and arrhythmia detection using Tiny Machine Learning (TinyML) models for real-time, on-device inference on resource-constrained embedded systems.
In short
The work presents a method using Tiny Machine Learning autoencoders for real-time, on-device ECG segmentation and arrhythmia detection. By training models to reconstruct normal heart rhythms, significant reconstruction errors signal abnormal beats. The optimized model achieves high accuracy with a small size and low latency, proving feasible for privacy-preserving wearable devices.
Key concepts
- Autoencoder
- An autoencoder is a neural network designed to learn efficient data representations by compressing input data into a lower-dimensional space (encoding) and then reconstructing the original input from that compressed representation (decoding). In this system, it learns what 'normal' ECG looks like.
- Quantization-Aware Training (QAT)
- QAT is a training technique used to prepare models for deployment on hardware that uses lower precision, such as 8-bit integers (INT8). By simulating this low-precision environment during training, the model learns to be robust against the quantization errors that occur when deploying it on an embedded microcontroller.
- Reconstruction Error Thresholding
- The system classifies an ECG segment as abnormal if its reconstruction error—the difference between the original signal and the reconstructed signal—exceeds a predefined threshold (theta). This method uses the model's failure to accurately reproduce normal patterns as a direct indicator of an underlying arrhythmia.
- TinyML
- Tiny Machine Learning refers to deploying machine learning models on extremely resource-constrained devices, such as low-power microcontrollers. The goal is to run complex tasks like arrhythmia detection locally on the device, ensuring real-time performance and preserving patient data privacy.
Terminology used across episodes
This episode discusses
- ArrythML: An Autoencoder-Based TinyML Approach for On-Device Arrhythmia Detection on Resource-Constrained Embedded Systems · Paper Radio
- Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networks
- ECG arrhythmia classification using a 2-D convolutional neural network
- Benchmarking TinyML Systems: Challenges and Direction
The paper
ArrythML: An Autoencoder-Based TinyML Approach for On-Device Arrhythmia Detection on Resource-Constrained Embedded Systems · Read on arXiv
International Institute of Information Technology Bangalore
DOI: 10.1109/ACCESS.2026.3751785
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: I'm Tom.
Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.
Tom: We're looking at the paper: "ArrythML: An Autoencoder-Based TinyML Approach for On-Device Arrhythmia Detection on Resource-Constrained Embedded Systems".
Jane: Here's the gist of the paper. Our work presents a method for ECG segmentation and arrhythmia detection using Tiny Machine Learning (TinyML) models for real-time, on-device inference on resource-constrained embedded systems.
Tom: These models are evaluated using a custom dataset derived from the MIT-BIH Arrhythmia Database and validated in both PC-based simulations and on-device environments.
Jane: The bestperforming DNN-based autoencoder achieves a recall of 84%, an F1-score of 79%, a model size of approximately 180 KB, and an inference latency of 9 ms on-device.
Tom: These results demonstrate the feasibility of low-power, privacy-preserving embedded wearable systems capable of performing accurate arrhythmia detection entirely on-device.
Title and authors: Tom: Okay, so we’re looking at 'ArrythML: An Autoencoder-Based TinyML Approach for On-Device Arrhythmia Detection on Resource-Constrained Embedded Systems' by Nagarajan and Kurian Polachan. We’ve already touched on the basics, but what's the actual implication of putting 'TinyML' into the picture for this kind of medical monitoring?
Jane: It means that instead of sending all those raw ECG data streams to a big computer to check for problems later, we can have an embedded system on a wearable patch do it instantly and locally. That could mean much faster alerts for patients in critical situations.
Lu: The implication is moving away from bulky workstations or Holter monitors that rely on complex rule-based software and instead creating something much more compact that runs continuously. They are targeting real-time inference on the edge, which changes the entire monitoring paradigm.
Meng: I wonder how robust this is when we talk about 'resource-constrained'. If the device has very little memory or processing power, does this model actually stay accurate enough to catch something dangerous?
Lalam: The paper shows they evaluated their models using over ninety-five thousand ECG segments processed on an ESP32-S3 microcontroller running the TensorFlow Lite Micro runtime <ref:2606.02256#pg1,processed on an ESP32-S3 microcontroller running the TensorFlow Lite Micro runtime>. That number gives a sense of the scale they tested against.
The paper's summary: Tom: So, summarizing the work, what is the central idea behind ArrythML? What exactly are they using this autoencoder for in terms of ECG analysis?
Jane: They are using an autoencoder with an encoder-decoder architecture. Think of it like this: you train it only on normal heart rhythms so it learns what a healthy ECG looks like, and then when a new segment comes in, if the reconstruction error is high, that means something abnormal happened.
Lu: Right, the core mechanism is thresholding the reconstruction error to classify segments as normal or abnormal. They specifically investigate two types of lightweight autoencoder variants: a Deep Neural Network based one and a Convolutional Neural Network based one eleven <ref:2606.02256#pg2>.
Meng: So, it’s not just about detecting an anomaly; they're using the structure of the autoencoder itself to qualitatively inspect the prediction. That sounds interesting for debugging, but what are the numbers on that inspection?
Lalam: The paper mentions that since the reconstructed signal represents what normal cardiac activity should look like, you can compare it visually to see exactly where it deviates from normal behavior. That helps designers understand *why* a prediction was made, not just *that* one was made.
The paper's improvements: Tom: Now let’s talk about what they improved over existing methods. What specific technical choices did they make to make their model work on such tight hardware?
Jane: They didn't just build a standard autoencoder; they developed quantization-aware training, or QAT. This is where they train the parameters while simulating INT8 precision to prepare the model for the actual low-precision eight-bit integers used on the device.
Lu: That QAT step is crucial because simply quantizing a trained model often degrades performance significantly, and they trained specifically to mitigate that degradation fifteen <ref:2606.02256#pg3>. They also focused on making both DNN and CNN variants very lightweight.
Meng: I’m looking at the size of the final model here, which is approximately one hundred eighty kilobytes. That's actually quite small for a deep learning model that can do this kind of analysis. What about the inference speed?
Lalam: On the ESP32-S3 microcontroller, they achieved an inference latency of nine milliseconds per segment, which is very fast for real-time monitoring applications.
Conclusion: Tom: So we’ve seen how they developed these lightweight models and trained them using quantization-aware training to get that small footprint and low latency. What’s the final verdict on what ArrythML delivers for on-device detection?
Jane: It shows that you can achieve a recall of eighty-five percent and an F1-score of seventy-nine point two one in the refined evaluation setting when deploying this DNN-based autoencoder on the ESP32-S3, which is a solid result for embedded deployment.
Lu: It confirms that this framework is feasible for low-power, privacy-preserving embedded wearable systems because it can perform accurate arrhythmia detection entirely on the device one.
Meng: From a deployment standpoint, achieving that nine millisecond latency on the edge means you can have continuous monitoring without draining the battery too quickly. What I’m still concerned about is how they handled those false positives and negatives we discussed earlier.
Lalam: The paper did conduct a record-wise failure analysis to characterize model behavior across diverse ECG morphologies and rhythm patterns, specifically noting that false positives often happen with records containing rhythm irregularities, and false negatives tend to occur when abnormal beats retain structures similar to normal sinus beats.
Tom: It seems like the next step for this kind of work is integrating it into custom hardware or maybe looking at multi-model approaches where you combine this autoencoder with simpler rule-based features for better beat-level annotation performance.
Jane: That makes sense, moving toward a hybrid approach to get that best of both worlds between the ML power and the clinical context. So, ArrythML gives us a concrete path toward making medical monitoring much more personal and immediate.
More episodes
- 2603.29765-Training-Free Dynamic Upcycling of Expert Language Models
- 2605.00778-Observable Performance Does Not Fully Reflect Adaptive System Organization: A Multi-Level Analysis of Gait Dynamics Under Occlusal Constraint
- 2605.06906-TraXion: Rethinking Pre-training Frameworks for Mobility and Beyond
- 2605.09165-Sparse Layers are Critical to Scaling Looped Language Models
- 2605.09439-Inverse Design for Conditional Distribution Matching
- 2605.10313-Signature Approach for Contextual Bandits with Nonlinear and Path-dependent Rewards: Regret Bound and Statistical Inference
- 2605.10878-Minimum Neural Weight Norm = Kolmogorov Complexity
- 2605.11617-MIST: Reliable Streaming Decision Trees for Online Class-Incremental Learning via McDiarmid Bound
- 2605.15085-From Data to Action: Accelerating Refinery Optimization with AI
- 2605.23500-GRTO: Bootstrapped Group Relative Tool Optimization for Referring Segmentation