BEAM3R: Beam's-eye-view architecture with Mamba-3 for implicit dose reconstruction
summary
The gist
To enable accurate and rapid photon control point and proton beamlet dose calculation in the DoseRAD2026 challenge…
In short
BEAM3R is a dose estimation framework using beam's-eye-view (BEV) to rapidly calculate photon and proton doses. It combines a Mamba-3 state-space model with physics conditioning to handle long-range transport without expensive 3D convolutions. The approach achieved similar accuracy for both modalities, demonstrating the power of BEV and depth modeling for fast radiation therapy dose prediction.
Key concepts
- Beam's-eye-view (BEV)
- This is a visualization method where the patient is viewed from directly above, like looking down onto a map. In this framework, it allows the model to see the entire cross-section of tissues along an axis (like axial slices) simultaneously, which helps in accurately modeling how radiation travels through different depths.
- Mamba-3 State-Space Depthsequence Core
- This is a specific type of neural network architecture used as the core engine for modeling dose transport. It uses state-space principles to efficiently capture long-range dependencies in the data, allowing it to model how radiation interacts with materials deep within the body without needing complex 3D convolutions.
- Proton Beamlet Conditioning
- For proton calculations, this involves feeding the model specific information about the beamlet's path. This includes factors like water equivalent thickness and remaining range, which are crucial physical parameters that determine where the Bragg peak (the maximum dose) will occur for that specific treatment.
- Bidirectional Mamba-3 Core
- This is a specialized version of the Mamba-3 core used in photon dose modeling. It allows the model to look both forward and backward along the depth axis. This capability helps capture complex, depth-dependent dose contributions from materials located downstream of the calculation point.
Terminology used across episodes
This episode discusses
- BEAM3R: Beam's-eye-view architecture with Mamba-3 for implicit dose reconstruction · Paper Radio
- Adam: A Method for Stochastic Optimization
- Decoupled Weight Decay Regularization
- Generating synthetic computed tomography for radiotherapy: SynthRAD2025 challenge report
- DoseRAD2026 Challenge dataset: AI accelerated photon and proton dose calculation for radiotherapy
The paper
BEAM3R: Beam's-eye-view architecture with Mamba-3 for implicit dose reconstruction · Read on arXiv
Chen Cheng, Michael Ferraro, James Grover, David E J Waddington, Emily Hewson
Image X Institute, The University of Sydney
Transcript
Introduction to the show: ident: Physics. The day in general physics: instruments, methods and results across the field.
Kai: I'm Kai.
Mira: And I'm Mira, here with Lev.
Kai: We're looking at the paper: "BEAM3R: Beam's-eye-view architecture with Mamba-3 for implicit dose reconstruction".
Paper summary: Kai: So, we're diving into this paper, "BEAM3R: Beam’s-eye-view architecture with Mamba-three for implicit dose reconstruction <ref:2609.04747#pg1,BEAM3R: Beam’s-eye-view architecture with Mamba-3 for implicit dose>." Essentially, the authors are tackling the need for super fast and accurate dose calculation when you're doing photon control point or proton beamlet dose estimation in the DoseRAD2026 challenge.
Mira: It claims they present BEAM3R, a framework that operates in beam’s-eye-view or BEV. The core idea is combining a Mamba state-space depthsequence core with physics based transport conditioning to handle longrange depth transport without using expensive three dimensional convolutions.
Lev: So, you're saying they are trying to model how the dose travels deep into the patient without needing those heavy three dimensional convolutions, which usually take a lot of computational power.
Kai: Exactly. They share a two dimensional convolutional encoder decoder architecture for both photon and proton dose tasks, processing these per plane BEV slices. And for proton beamlets specifically, they condition them on water equivalent thickness and the remaining range, which are the parameters that determine where the Bragg peak is going to be.
Mira: For the photon models, they use a bidirectional Mamba-three core to capture those dose contributions coming from materials downstream of the calculation point <ref:2609.04747#pg1,use a bidirectional Mamba-3 core to capture>. That's their specific approach for photon modeling.
Lev: That bidirectional aspect sounds interesting because it lets you see what’s happening on both sides of the calculation point simultaneously. What is this about?
Kai: The input handling is also quite specific to the task; for MRI tasks, they generate synthetic computed tomography or sCT using a patch based conditional generative adversarial network with a SwinUNETR backbone.
Mira: And for proton inputs, they feed it the normalized computed tomography, the Gaussian spot fluence, the cumulative water equivalent thickness and that remaining range we just talked about. They snap the BEV lattice to CT slice positions along the axial axis, which eliminates interpolation errors in that direction.
Lev: That sounds like a lot of specific input conditioning to handle different types of patient data and beam physics simultaneously. How do they train this whole thing?
Kai: They used a staged learning approach for the dose prediction models to speed up how fast they converge. For photon training, it started with a unidirectional model trained on the thorax cohort before fine tuning on combined cohorts.
Mira: The losses are defined in two parts: one for photons that's mean squared error plus a mean absolute error term weighted by something called P i Mi, and then for protons it's similar but with an extra term involving a valid loss to make sure the predictions are physically sensible.
Lev: Those losses look like they are trying to balance just getting the right number with ensuring the result is also plausible in terms of dose distribution. What did you find out about performance?
Paper summary: Kai: The CT based photon and proton models achieved similar beam level accuracy with a masked mean absolute error of zero point eighty-four for both tasks. But they noted that performance decreased when planning CT was replaced by sCT, with a substantially larger reduction for the proton prediction than for the photon prediction.
Mira: They also experimented with increasing model representational capacity through BEV extent and bidirectional depth modelling, and grid snapping along the S I direction and training in CT space utilizing super sampling enabled significant accuracy improvement because it reduced interpolation error.
Lev: That’s a lot of tuning to get that accuracy boost, especially with the grid snapping. What about those reverse depth models they mentioned?
Kai: The reverse depth Mamba branch improved the IDD distance more than masked mean absolute error, which aligns with its intended role in modeling those depth dependent effects.
Mira: Their limitations are that the performance of the sCT model depends on scanner characteristics, and they also used simplified approximations for the residual stopping power and range, which might not generalize beyond just the energies and anatomy in that challenge dataset.
Lev: So what would someone who only listens to this show actually take away from this work?
Kai: They should understand that by using this BEAM3R architecture, you can get accurate and rapid photon control point and proton beamlet dose calculation. It’s about making those calculations much faster while keeping the accuracy high enough for clinical use in environments like the DoseRAD2026 challenge.
Mira: The authors are showing how a Mamba architecture, combined with specific physics conditioning, can model deep transport without needing those heavy three dimensional convolutions. It’s moving away from older methods that rely on explicit three dee geometry <ref:2609.04747#pg1>.
Lev: It seems like the main argument is that this approach provides a way to improve beam level modelling for flexible plan optimisation and dose accumulation workflows, which is what people in clinical planning want.
Kai: To sum up, the paper shows how this BEAM3R architecture can deliver good beam level accuracy for both photon and proton tasks using a Mamba core on per plane slices within a beam's-eye-view framework.
Mira: The final point is that while it’s accurate on the test set with metrics like stratified mean absolute error of zero point eighty-four the performance still depends on things like the quality of sCT and those simplified range approximations they mentioned.
Lev: And for real hardware implementation, we need to keep in mind that even with this fast framework, you're still relying on these physics based transport conditionings for protons.
Kai: Exactly. The paper is a solid piece of work because it shows a viable path toward faster dose estimation using modern sequence models and state space architectures instead of just brute force methods.
Conclusion: Kai: So, we're wrapping up on BEAM3R, which is this framework that uses beam’s-eye view modeling with Mamba to estimate photon and proton doses for radiotherapy planning and delivery.
Mira: It seems like the authors are really focusing on making deep transport modeling faster by using state space models instead of those heavy three dimensional convolutions.
Lev: From an error correction standpoint, if you could run that on real hardware, it would be a huge win because we're still wrestling with approximating those long range dose contributions.
Kai: They did show that they got similar beam level accuracy for both photon and proton tasks using this method, though they pointed out some trade-offs when swapping in synthetic computed tomography for the actual CT scans.
Mira: The core idea is that the bidirectional Mamba core helps capture those things happening downstream without needing to process every single voxel in a massive three dimensional grid.
Lev: So it’s not just about speed; it’s about how they condition the input data, like using water equivalent thickness and remaining range to tell the proton model exactly what to expect at the Bragg peak position.
Kai: Yeah, and they found that increasing the model's capacity by extending that beam’s-eye view depth actually helped improve accuracy because it cut down on interpolation errors in a specific direction.
Mira: But they also had those limitations, you know, like how much the sCT model performs really depends on the scanner itself and those simplified range approximations they used.
Lev: Right, so even if the math looks clean and fast, you still have to worry about how well that physics conditioning holds up in a real clinical setting.
Kai: It’s a solid piece of work because it shows a viable path toward faster dose estimation using sequence models instead of just brute force methods.
Mira: And it opens up new ways to handle the complexities of photon and proton calculations in planning workflows that are currently much slower than what’s needed for real time guidance.
Lev: Next up, we need to look at how this framework compares when you're talking about actually running these things on real hardware versus just theoretical accuracy.
More episodes
- 2611.14082-Two atoms with strong light-induced dipolar interactions
- 2611.14040-Characterization of BNLs 20 and 30 micrometer thick LGADs for the Electron Ion Collider
- 2611.13399-Lift-element-based dynamic network of vortex gust-airfoil interactions
- 2611.13476-Hopfion Superlattices in 3D Twisted Moir'e Light Fields
- 2611.13642-Investigation of the timing performance of double-sided p-type 3D silicon sensors produced by CNM
- 2611.13830-SiPM optical readout of a PICOSEC Micromegas precise timing detector
- 2611.14152-Where are the shortest-path nodes in spatial networks?
- 2611.14219-Sub-Ice: semi-automated mapping of basal channels from ice shelf surface elevation data
- 2611.16341-SUMNO: Spatially Unrolled Multigrid Neural Operator for Fluid Flow Surrogates
- 2611.16090-Multi-UTE Myelin Fraction Mapping: Repeatability and Cross-Field-Strength Reproducibility at 1.5T and 3T