Transformer-Based Heartbeat Monitoring with FMCW Radar Under Random Body Motion
summary
The gist
Millimeter-wave Frequency Modulated Continuous Wave (FMCW) radar enables contactless cardiac monitoring…
In short
This work addresses challenges in contactless cardiac monitoring using 77 GHz FMCW radar, where breathing and body motion distort heart signal detection. The proposed hybrid framework combines traditional signal processing with a CNN-Transformer network to accurately reconstruct the photoplethysmography (PPG) signal. Results show robust performance across stationary, breathing, and random motion scenarios, outperforming benchmark methods.
Key concepts
- FMCW Radar
- Frequency Modulated Continuous Wave radar uses radio waves with a continuously changing frequency to measure distance and velocity. In this study, 77 GHz FMCW radar is used to detect chest movements without physical contact, making it suitable for contactless heart monitoring.
- Model-Based Signal Processing
- This initial step converts raw radar measurements into meaningful features. It involves processing the signal to remove static clutter, identify the chest reflection, and estimate key physiological parameters like amplitude and velocity. This creates a set of physically relevant data points for the neural network.
- CNN-Transformer Network
- This deep learning component takes the extracted features from radar as input. The CNN part processes these features to learn spatial patterns, while the Transformer part models complex temporal dependencies to reconstruct the original PPG signal, which represents heartbeat activity.
Terminology used across episodes
This episode discusses
- Transformer-Based Heartbeat Monitoring with FMCW Radar Under Random Body Motion · Paper Radio
- An Overview of Algorithms for Contactless Cardiac Feature Extraction from Radar Signals: Advances and Challenges
- Tune: A Research Platform for Distributed Model Selection and Training
The paper
Transformer-Based Heartbeat Monitoring with FMCW Radar Under Random Body Motion · Read on arXiv
Department of Information Engineering, University of Pisa · Radar and Surveillance Systems (RaSS) National Laboratory, CNIT
DOI: 10.1109/RadarConf2663773.2026.11674955
Transcript
Introduction to the show: ident: Electrical Engineering. The day in electrical engineering: signals, systems and the hardware that carries them.
Rosa: We're looking at the paper: "Transformer-Based Heartbeat Monitoring with FMCW Radar Under Random Body Motion".
Dev: Here's the gist of the paper. Millimeter-wave Frequency Modulated Continuous Wave (FMCW) radar enables contactless cardiac monitoring, but heartbeat estimation becomes challenging when respiration and random body motion (RBM) distort the radar signal <ref:2605.28432#pg2> This paper proposes a hybrid framework for 77 GHz FMCW radar that combines model-based signal processing with a Convolutional Neural Network (CNN)–Transformer network <ref:2605.28432#pg2>.
Rosa: The proposed method consists of two main components: a model-based signal processing block and a CNN–Transformer network <ref:2605.28432#pg2> The first component processes raw mmWave FMCW radar measurements into physiologically meaningful features (time series) <ref:2605.28432#pg2>.
Dev: The second component, the CNN–Transformer network, processes these extracted features to reconstruct the photoplethysmography (PPG) signal <ref:2605.28432#pg2>.
Rosa: Signal Processing Pipeline The model-based block involves several steps to convert raw radar data into features <ref:2605.28432#pg2> 1.
Title and authors: Rosa: We’re diving into "Transformer-Based Heartbeat Monitoring with FMCW Radar Under Random Body Motion" and the folks who wrote it, Matteo Pardi, Amir Hosein Oveis, Saba Kharabadze, Ajeet Kumar. This paper tackles that core issue of heart monitoring using millimeter wave radar when things get physically messy.
Dev: It’s interesting how they framed the problem right up front by focusing on the challenge: when respiration and random body motion distort the radar signal, it makes heartbeat estimation really difficult.
Taro: They propose a hybrid framework, combining model-based signal processing with a CNN Transformer network to handle that distortion.
Rosa: So, instead of just throwing raw data at a deep learning model, they first use the model-based block to extract features like chest displacement time series from the radar measurements.
Dev: That feature extraction step is crucial because it’s what converts the raw physical wave data into something that has some physiological meaning for the next stage.
Taro: They detail how this involves things like range processing and then estimating chest velocity using wrapped phase differences, which is key to getting that displacement estimate.
Rosa: And they spend time on refining those velocity samples because they recognize that if you just use raw measurements, it can lead to errors when the range bins migrate.
Dev: That interpolation step is what allows the system to handle the inherent noise from random body motion better by replacing unreliable samples with estimates from reliable neighbors.
Taro: After getting that displacement estimate, they construct eight different feature channels, including amplitude and a coarse random body motion indicator, which feeds into the neural network.
Rosa: Then this whole set of features goes into the CNN Transformer network to reconstruct a photoplethysmography signal that mimics what we see in a real heartbeat.
Dev: So it’s not just one black box; it’s a structured pipeline where you have these physical estimations feeding into a powerful sequence model for reconstruction.
Taro: And the architecture involves a convolutional stem to map those features to some latent embedding, followed by positional encoding, then the Transformer encoder handling the temporal relationships.
Rosa: It sounds like they are trying to give the network both a structural understanding of the data and an understanding of how things change over time.
Dev: That’s what I mean. Giving it context on where those features came from before letting it figure out the complex temporal patterns is a smart design choice for this problem.
Taro: The architecture shows they are modeling both the static structure of the signal and its dynamic evolution, which is important when you're dealing with breathing and motion.
Rosa: And they used synchronized photoplethysmography signals as their ground truth during supervised training to guide that reconstruction process effectively.
Dev: That ground truth synchronization is a big piece of information because it gives the AI a clear target to aim for during the learning phase.
The paper's summary: Taro: So, what they actually say in their summary is that this hybrid approach successfully combines the model-based processing with the CNN Transformer network to solve the problem of heart rate estimation under random body motion.
Rosa: Essentially, they argue that separating the tasks—feature extraction and signal reconstruction—allows each component to focus on its specific job better than a single end-to-end model could.
Dev: They’re trying to show that this separation leads to more physiologically meaningful features derived from the raw radar data before feeding them into the AI for pattern recognition.
Taro: The paper summarizes that they are extracting chest displacement and constructing high-level motion features from the raw radar data in the first block, while then using these features to reconstruct a PPG-like signal in the second block.
Rosa: They’re emphasizing that this two-block structure is what makes the entire method capable of handling both breathing and random movement effectively.
Dev: They highlight how this method is designed to be robust by explicitly addressing motion corruption through the feature engineering part before letting the deep learning component do its heavy lifting.
Taro: So, when you read the summary, it’s clear they are focusing on creating features that are less susceptible to noise introduced by those environmental factors before they get processed by the network.
Rosa: They’re essentially saying that this structured approach is superior because it forces a physical interpretation of the data before letting the AI get involved.
Dev: And this structural approach is what allows them to achieve results across all three test conditions: stationary, deep breathing, and random body motion.
The paper's improvements: Rosa: They suggest improvements mainly in how they refine those model-based features to better separate the motion components from the cardiac signals when looking at Figure four <ref:2605.28432#pg2>.
Dev: They are focusing on refining that feature construction block because they think making those handcrafted features more physically meaningful will make them less susceptible to noise from random body motion.
Taro: Specifically, they want to improve how the features are built so that they can better isolate the heart signal from the movement artifacts in a way that’s more robust.
Rosa: So, if you look at Figure four they’re suggesting tweaks there to make sure those features are cleaner inputs for the deep learning block <ref:2605.28432#pg2>.
Dev: That means refining the feature engineering part so that when we move through the world, the resulting features stay closer to what a heartbeat actually is.
Taro: The goal of these improvements is to ensure that whatever motion profile you encounter, the system recovers gracefully instead of completely breaking down its estimation capabilities.
Rosa: So they are looking at making those handcrafted features more robust inputs for the deep learning component when dealing with real-world movement.
Dev: And from a practical standpoint, if those features are cleaner, it means we might be able to use lighter models in the second block while still getting high accuracy.
Conclusion: Rosa: So, wrapping up the paper "Transformer-Based Heartbeat Monitoring with FMCW Radar Under Random Body Motion," the main conclusion is that their hybrid framework reliably reconstructs the PPG signal across all tested scenarios.
Dev: They’ve shown that this method outperforms existing techniques for metrics like average heart rate and heart rate variability when conditions are nonideal or affected by unwanted motion.
Taro: They demonstrated that it still follows the overall trend of the true photoplethysmography and correctly detects main peaks even in the random body motion scenario, which is a strong result.
Rosa: The implication is that this provides a reliable tool for radar-based vital sign monitoring in environments where you can't guarantee perfect stillness.
Dev: It’s practical because it moves us closer to having non-contact cardiac monitoring that can actually be used in more realistic, dynamic settings than just a lab bench.
Taro: The future work they mentioned is testing other neural networks to see if those variations can improve the performance and also reduce the computational cost of this entire system.
Rosa: It’s a solid result showing that the proposed architecture works well under motion-corrupted conditions, confirming its practical value for tracking vital signs in realistic environments.
More episodes
- Daily Summary for 2026-11-19
- 2111.07910-Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction
- 2203.02149-HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging
- 2205.10102-Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging
- 2311.10959-Structure-Aware Sparse-View X-ray 3D Reconstruction
- 2403.04116-Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis
- 2410.02572-Combining Pre- and Post-Demosaicking Noise Removal for RAW Video
- 2604.17453-Learned Nonlocal Feature Matching and Filtering for RAW Image Denoising
- 2603.20387-End-to-End Multi-Task Learning for Adjustable Joint Noise Reduction and Hearing Loss Compensation
- 2507.20825-Chirp-Permuted AFDM: A Versatile and Multifunctional Waveform for 6G