Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.
Rosa: We're looking at the paper: "Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree".
Dev: Here's the gist of the paper. Modular soft magnetic robotic catheter enables multifunctional, autonomous navigation and therapy in millimeter-scale anatomy<ref:2601.14837#pg2> This work establishes a scalable platform for multifunctional soft robotic catheters and introduces a new paradigm for complex endoluminal interventions<ref:2601.14837#pg4> The paper presents a 1.47-mm-diameter modular soft robotic catheter that integrates sensing, actuation, and therapeutic capabilities while retaining the compliance needed for safe endoluminal navigation<ref:2601.14837#pg3> This platform is hardware-agnostic, being deployable through standard clinical tools and actuated via any magnetic manipulation system, either using permanent or electro-magnet<ref:2601.14837#pg4> The device can be configured with up to four independent functional modules, including onboard imaging, a tendondriven compliant gripper, tunable magnetic anchoring balloons, and ultrasound-triggered drugrelease coatings<ref:2601.14837#pg4> System Architecture and Modularity The modular architecture supports up to four independently controlled functional units, enabling customizable combinations of anchoring, manipulation, sensing, and targeted drug delivery<ref:2601.14837#pg4> The catheter body integrates 100-µm microchannels, a miniature camera with LED illumination, and markers for pose estimation within the 1.47-mm outer diameter<ref:2601.14837#pg3> Magnetic actuation was achieved by a large external permanent magnet (EPM) mounted onto a 7-DOF robotic manipulator positioned at the patient’s bedside<ref:2601.14837#pg5> The operator interface integrates two joysticks (one for EPM pose, one for module actuation), an automated advancing unit for feed/retraction, and a computer-controlled insufflation system<ref:2601.14837#pg5> Navigation and Control Strategy A closed-loop autonomous/shared-control system, combining a learned model, magnetic actuation, onboard shape sensing, and visual marker tracking, further enhances cannulation accuracy<ref:2601.14837#pg2> The autonomous control pipeline couples a YOLOv8 detection algorithm with a magnetic steering model and an FBG shape sensor to perform insertion<ref:2601.14837#pg9> The detector identifies the papilla and two mSCR tip markers from endoscopic video and estimates the tip orientation, achieving a precision of 0.81, recall of 0.76, and an F1 score of 0.78<ref:2601.14837#pg10> The angular error relative to the desired entry line is mapped to a desired deformation, which a dipole–dipole magnetic model converts into an EPM pose<ref:2601.14837#pg10> Functional Module Validation The compliant gripper enabled reliable object and tissue grasping in bench and in vivo experiments<ref:2601.14837#pg8> Peak gripping force without anchoring was 0.43 ± 0.06 N, which increased to 1.28 ± 0.16 N when combined with the anchoring balloon, a 300% improvement<ref:2601.14837#pg8> The micropatterned PLA shell provides on-demand therapeutic release under a 1 MHz acoustic trigger while remaining inert under standard imaging ultrasound (7–28 MHz)<ref:2601.14837#pg6> In vivo trials validated successful on-demand release after navigation across the bile duct, as well as in the gastrointestinal tract and the lung<ref:2601.14837#pg6> Biocompatibility and Safety The biocompatibility analysis showed that there was no significant difference in the metabolic activity of cells between conditions for a 24-hour exposure time<ref:2601.14837#pg25> The results showed no significant difference in the metabolic activity of the cells between the different conditions for a 24-hour exposure time<ref:2601.14837#pg25> By uniting magnetically enabled shape control with task-level functionality, imaging, manipulation, anchoring, and on-demand therapy, this platform advances soft robotic catheters towards practical clinical impact<ref:2601.14837#pg11> The system supports both exploratory open-loop navigation (enabled by on-board vision) and autonomous navigation for planned procedures<ref:2601.14837#pg10> This approach aims to reduce reliance on ionizing radiation, shorten the learning curve for complex navigation (e.g., ERCP), and provide a blueprint for procedure-specific modularity<ref:2601.14837#pg11> The work demonstrates that a magnetic catheter can be used safely in a highly sensitive environment and, in the context of ERCP, potentially help reducing a major cause of long-term side effects for patients<ref:2601.14837#pg11> Materials and Methods Soft robotic catheter bodies were produced by low-pressure injection molding using high-resolution molds<ref:2601.14837#pg13> The magneto-elastic matrix consisted of a 1:1 mass mixture of neodymium-iron-boron powder with 5 µm particles and DragonSkin 30 silicone that was mixed and degassed in a planetary mixer<ref:2601.14837#pg13> The compliant gripper is inspired by a flexure-based L-arm mechanism in which a central shuttle translates relative to a fixed base to close the jaws<ref:2601.
Title and authors: Rosa: We've been talking about the modular magnetic soft robotic catheter enabling visualized intervention in the pancreatobiliary tree, and now we’re diving into what that actually means for complex procedures. This paper proposes a new way to approach endoluminal interventions by using these small, flexible devices to navigate and then perform tasks like imaging or therapy inside areas like the pancreas and bile ducts.
Dev: It sounds like they're moving beyond just navigating passively; they’re talking about delivering clinically actionable functions right there in the procedure.
Taro: I'm looking at how they tackle the navigation problem because that’s usually the hardest part in these delicate spaces, right?
Rosa: That’s where their closed-loop control strategy comes into play, combining onboard shape sensing with real-time tracking based on a convolutional neural network model for autonomous insertion.
Dev: So it uses computer vision from the video feed to guide itself toward the target anatomy without needing constant manual steering input.
Rosa: Precisely, and they achieve this by mapping the angular error relative to where it should go into a desired deformation, which they then convert into a magnetic pose for an external permanent magnet.
Taro: That sounds like a real step away from just having the surgeon manually guide the tip through the duct.
Dev: It is, and they found that this autonomous control pipeline couples a YOLO v8 detection algorithm with that magnetic steering model and fiber Bragg grating shape sensor to perform insertion.
The paper's summary: Rosa: So what's the core of what they achieved in "Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree"? They built a miniaturized, multifunctional soft robotic catheter that integrates sensing, actuation, and therapeutic capabilities while keeping the compliance needed for safe endoluminal navigation.
Dev: It’s important to understand that this isn't just about navigation; it’s about making the catheter functional in multiple ways. They can configure up to four independent functional modules on this platform.
Taro: I'm interested in those modules because they sound like they could do a lot of different things, from grasping tissue to releasing drugs.
Rosa: Yes, for example, you have an onboard imaging system with an LED illumination, a tendondriven compliant gripper for grasping objects or tissue, tunable magnetic anchoring balloons for stabilization, and ultrasound-triggered drug release coatings.
Dev: The modular architecture supports up to four independently controlled functional units so you can choose the right combination of anchoring, manipulation, sensing, and targeted drug delivery based on the specific procedure.
Rosa: And they validated these functional modules in experiments; for instance, the compliant gripper showed a peak gripping force of zero point forty-three Newtons without anchoring balloon and it jumped to one point twenty-eight Newtons when combined with that balloon, which is about a three hundred percent improvement.
The paper's improvements: Dev: Looking at the proposed improvements, one major thing they highlight is the enhanced manipulation stability achieved by combining that degree of machine intelligence with an autonomous insertion strategy and a magnetic balloon for stabilization.
Taro: So, when the world misbehaves or things get slippery during insertion, does this system handle it better than a purely manual approach?
Dev: Yes, they found that this combination resulted in a mean insertion time of two hundred twenty-three plus or minus ten seconds across two porcine models compared to two hundred fifty-three plus or minus twenty three seconds when an operator was controlling the system.
Rosa: That's a solid improvement in terms of speed and reliability, and it really shows how machine intelligence can help reduce the operator burden during this critical cannulation phase.
Taro: What about those therapeutic aspects? Are they just theoretical releases, or did they actually work in a relevant setting?
Dev: They have validated on-demand release using micropatterned PLA coating around the mSCR with a designed micropattern that resonates near one megahertz, allowing for drug release triggered by insonation while remaining inert under standard imaging ultrasound at seven to twenty eight megahertz.
Rosa: And those in vivo trials confirmed successful on-demand release after navigating across the bile duct, as well as inside the gastrointestinal tract and even the lung.
Conclusion: Rosa: So to wrap up this discussion on "Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree", what we have is a platform that unites magnetically enabled shape control with task-level functionality, imaging, manipulation, anchoring, and on-demand therapy.
Dev: It really advances soft robotic catheters toward practical clinical impact by supporting both exploratory open-loop navigation enabled by onboard vision and autonomous navigation for planned procedures.
Taro: I'd add that this approach aims to reduce reliance on ionizing radiation and shorten the learning curve for complex navigation, like in an ERCP procedure, which is a huge consideration.
Rosa: They’re showing that a magnetic catheter can be used safely in a highly sensitive environment, and specifically in the context of ERCP, it could potentially help reduce major causes of long-term side effects for patients.
Dev: It’s an interesting platform because it offers flexibility; they are showing a blueprint for procedure-specific modularity that can adapt to different needs.
Taro: The paper shows that when you combine magnetic shape control with task functionality, you get a system that is both safe enough and versatile enough for complex internal work.
Rosa: And we'll keep an eye on how this technology moves from the lab bench into actual clinical settings after this deep dive into the "Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree".
B. Calmé, N. J. Greenidge, A. Metcalf, A. Bacchetti, G. Loza, D. Kpeglo, P. Lloyd, V. Pensabene, J. H Chandler, P Valdastri
STORM Lab, University of Leeds Institute of Medical Research at St James’ University Hospital, University of Leeds
cs.RO
Submitted: 2026-01-21
Updated: 2026-11-06
Comments: 31 pages, 7 figures, 1 table, 7 supplementary figures
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 92/100
The gist: Modular soft magnetic robotic catheter enables multifunctional, autonomous navigation and therapy in millimeter-scale anatomy<ref:2601.14837#pg2> This work establishes a scalable platform for…
Key concepts
- Modular Architecture
- The catheter is designed with up to four independent functional modules that can be combined for different tasks like anchoring, sensing, manipulation, or drug delivery. This modularity allows the same physical device to be customized for various clinical needs and procedures.
- Autonomous Navigation Pipeline
- This system uses a closed-loop control strategy combining a learned model (YOLOv8), magnetic steering, and shape sensing. It analyzes endoscopic video to detect anatomical features like papillae and markers, calculating the required deformation to guide the catheter autonomously toward its target.
- Ultrasound-Triggered Drug Release
- A micropatterned PLA coating surrounds the catheter tip. This coating is designed to release therapeutic agents only when triggered by a specific 1 MHz acoustic signal, ensuring on-demand drug delivery while remaining safe and inert during standard imaging ultrasound (7–28 MHz).
- Hardware Agnosticism
- The platform is designed to be compatible with various external systems. It can be deployed using standard clinical tools and operated by any magnetic manipulation system, whether using permanent or electromagnetic magnets, making it adaptable to different setups.
Terminology
Summary
Modular soft magnetic robotic catheter enables multifunctional, autonomous navigation and therapy in millimeter-scale anatomy<ref:2601. p. 0 This work establishes a scalable platform for multifunctional soft robotic catheters and introduces
a new paradigm for complex endoluminal interventions, with the potential to reduce radiation
exposure, shorten training requirements, and accelerate the clinical translation of soft robotic
technologies. One-Sentence Summary: Modular soft magnetic robotic catheter enables multifunctional,
autonomous navigation and therapy in millimeter-scale anatomy A closed-loop autonomous/shared-control system, combining a learned model, magnetic
actuation, onboard shape sensing, and visual marker tracking, further enhances cannulation
accuracy. This work establishes a scalable platform for multifunctional soft robotic catheters and introduces
a new paradigm for complex endoluminal interventions, with the potential to reduce radiation
exposure, shorten training requirements, and accelerate the clinical translation of soft robotic
technologies. We present a 1. 47-mm-diameter modular soft robotic catheter that integrates sensing, actuation,
and therapeutic capabilities while retaining the compliance needed for safe endoluminal navigation. 47 mm outer-diameter modular soft robotic catheter that combines magnetic
steerability with multi-functionality while preserving compliance for safe navigation. Our platform
is hardware-agnostic, being deployable through standard clinical tools and actuated via any
magnetic manipulation system, either using permanent or electro-magnet. Our platform
is hardware-agnostic, being deployable through standard clinical tools and actuated via any
magnetic manipulation system, either using permanent or electro-magnet. The device can be
configured with up to four independent functional modules, including onboard imaging, a tendondriven compliant gripper, tunable magnetic anchoring balloons, and ultrasound-triggered drugrelease coatings.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
System Architecture and Modularity
The modular architecture supports up to four independently controlled functional units, enabling customizable combinations of anchoring, manipulation, sensing, and targeted drug delivery<ref:2601.14837#pg4> The catheter body integrates 100-µm microchannels, a miniature camera with LED illumination, and markers for pose estimation within the 1. p. 2 RESULTS
Robotic platform overview
Building upon prior work on mSCR design and control [14], [23], we developed a miniaturized,
multifunctional mSCR that combines robust magnetic steerability with three functional modules: a
compliant gripper, a hyperelastic magnetic anchoring balloon, and a micro-patterned biocompatible
polylactic acid (PLA)-coating for ultrasound-triggered drug release. The catheter body integrates
100-µm microchannels, a miniature camera with LED illumination, and markers for pose
estimation, all within the 1. Here, we present a 1. 47 mm outer-diameter modular soft robotic catheter that combines magnetic
steerability with multi-functionality while preserving compliance for safe navigation. Magnetic actuation was achieved by a large external permanent magnet (EPM) mounted onto a 7-
DOF robotic manipulator positioned at the patient’s bedside (Fig. The EPM was placed 18 cm
above the patient chest, with software-defined motion limits to ensure patient safety (Fig. 72 N·m (Fig. The operator interface integrates two joysticks (one for EPM pose, one for module actuation), an
automated advancing unit for feed/retraction, and a computer-controlled insufflation system.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Navigation and Control Strategy
A closed-loop autonomous/shared-control system, combining a learned model, magnetic actuation, onboard shape sensing, and visual marker tracking, further enhances cannulation accuracy<ref:2601.14837#pg2> The autonomous control pipeline couples a YOLOv8 detection algorithm with a magnetic steering model and an FBG shape sensor to perform insertion<ref:2601. p. 7 (D) In vivo lung navigation visualized from the bronchoscope, showing
sequential steering into two distinct airway branches. Video-based Autonomous magnetic steering
To reduce operator burden and handle the nonlinearities of magnetic actuation, we implemented an
autonomous-control pipeline that couples a YOLOv8 detection algorithm, a magnetic steering
model and a fiber Bragg grating (FBG) shape sensor. The detector identifies the papilla and two
mSCR tip markers from endoscopic video and estimates the tip orientation. The detector achieved
precision = 0. The detector achieved
precision = 0. 81, recall = 0. 78 on a dataset combining phantom, ex vivo and in vivo
images (n =3800 images). The angular error relative to the desired entry line is mapped to a desired deformation, which a
dipole–dipole magnetic model converts into an EPM pose.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Functional Module Validation
The compliant gripper enabled reliable object and tissue grasping in bench and in vivo experiments<ref:2601.14837#pg8> Peak gripping force without anchoring was 0. p. 6 Geometric optimization of the flexures produced strong agreement
between model predictions and measured jaw deflections and the triggering force with less than 7%
deviation (n = 30 trials, Fig. Peak gripping force without anchoring was 0. The operator can
displace objects of different shapes and textures. The gripping force can be increased by a factor of
2. When combined with the
anchoring balloon, effective gripping force increased to 1. 16 N (n=2, N=60), a ~300%
improvement (Fig. The coating remains inert under imaging
ultrasound, but fractures under 1 MHz actuation, releasing the payload on demand. The pattern on
the molded shell had an area of 401. In vivo trials validated successful on-demand release
after navigation across the bile duct (Fig. 2E), as well as in the gastrointestinal tract and the lung
(Fig.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Biocompatibility and Safety
The biocompatibility analysis showed that there was no significant difference in the metabolic activity of cells between conditions for a 24-hour exposure time<ref:2601.14837#pg25> The results showed no significant difference in the metabolic activity of the cells between the different conditions for a 24-hour exposure time<ref:2601.14837#pg25>
Conclusion and Clinical Potential
By uniting magnetically enabled shape control with task-level functionality, imaging, manipulation, anchoring, and on-demand therapy, this platform advances soft robotic catheters towards practical clinical impact<ref:2601.14837#pg11> The system supports both exploratory open-loop navigation (enabled by on-board vision) and autonomous navigation for planned procedures<ref:2601. p. 7 Magnetic steering and navigation
Open-loop control exploration
Beyond initial entry into the major papilla, ERCP typically relies solely on external imaging
because conventional guidewires lack onboard visualization. This limitation is common across
many procedures performed in small-diameter lumens. This work establishes a scalable platform for multifunctional soft robotic catheters and introduces
a new paradigm for complex endoluminal interventions, with the potential to reduce radiation
exposure, shorten training requirements, and accelerate the clinical translation of soft robotic
technologies. One-Sentence Summary: Modular soft magnetic robotic catheter enables multifunctional,
autonomous navigation and therapy in millimeter-scale anatomy Moreover, the current procedure requires a specific
endoscope with a side view, the duodenoscope, complicating the navigation down to the duodenum. As a result, ERCP procedures are technically demanding for the operator and tend to generate longterm side effects and complications for the patient, motivating the need for softer, multifunctional,
and controllable tools.Where the paper says it
Where the paper says it
Where the paper says it
Materials and Methods
Soft robotic catheter bodies were produced by low-pressure injection molding using high-resolution molds<ref:2601.14837#pg13> The magneto-elastic matrix consisted of a 1:1 mass mixture of neodymium-iron-boron powder with 5 µm particles and DragonSkin 30 silicone that was mixed and degassed in a planetary mixer<ref:2601. p. 1 By embedding hardmagnetic microparticles, e. , NdFeB (neodymium-iron-boron), into soft elastomers, these devices
can undergo programmable magnetization for complex shape reconfigurations [9], [10], [11], [12]
in response to external fields while preserving compliance. Their geometry is optimized to distribute local
strains, produce a desired shape change, and avoid stress concentrations. Our gripper is inspired by
a flexure-based L-arm mechanism [31], [32] in which a central shuttle translates relative to a fixed
base to close the jaws.Where the paper says it
Where the paper says it
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Autonomous insertion through an orientation estimation pipeline allows for
true first-person visual navigation without dependence on external imaging modalities such as X-ray
by coupling a YOLOv8 detector with a magnetic steering model and fiber Bragg grating sensor to compute the geometric angle between markers and the papilla entry. This system enablesautonomous navigation
which has shown that autonomy outperformed manual control in vivo, reducing operator burden during papilla cannulation. -
Closed-loop autonomous/shared-control system enhances cannulation accuracy by combining a
learned model, magnetic actuation, onboard shape sensing, and visual marker tracking.
This integration allows the system to performsemi-autonomous deployment into the pancreatic duct
and achieve precise tip orientation using an EPM pose derived from video processing. -
Enhanced manipulation stability is achieved by combining a
degree of machine intelligence by providing an autonomous insertion strategy
with a magnetic balloon for stabilization, resulting in a mean insertion time of t = 223 +/- 10 s across two porcine models compared to t = 253 +/- 23 s when the system was controlled by an operator. -
Targeted therapy delivery is enabled by ultrasound-triggered drug release using a
micrometer-thick PLA coating around the mSCR with a designed micropattern
that resonates near 1 MHz, allowing foron-demand release
triggered by insonation while remaining inert under standard imaging ultrasound (7–28 MHz). -
The platform supports hardware agnosticism, being deployable through
standard clinical tools and actuated via any magnetic manipulation system,
allowing the device to be used with various endoscopes such as a duodenoscope or gastroscope for ERCP.
Abstract
Diagnosis and therapy in the pancreatobiliary tree are limited by access. Guidewires reach deep into the ducts but are blind, whereas cholangioscopes provide vision but are too large to readily enter the pancreatic body and tail, the cystic duct, or the gallbladder. At the millimeter scale of these ducts, every function added to a steerable catheter competes with steering for cross-section and adds bending stiffness. We present a 1.47-mm modular magnetic soft robotic catheter in which each function is built into the magnetic body, onto its surface, or onto the footprint of the camera, and we measured what each function costs in bending under bedside fields. Imaging and fiber Bragg grating (FBG) shape sensing accounted for most of this cost, whereas a compliant gripper, magnetic anchoring balloons, and a micrometer-thick ultrasound-triggered release shell together reduced the tip angle at 8 mT only from 70° to 64°. The anchoring balloon increased the gripping force about threefold without stiffening the catheter during navigation. In live pigs, the robotic catheter performed operator-initiated task-autonomous cannulation of the native papilla without sphincterotomy and was teleoperated under onboard vision 75 mm into the pancreatic duct and, without a guidewire, through the cystic duct into the gallbladder, whose lumen it imaged. Anchoring, grasping, and payload release were each demonstrated in vivo. Adding each function at a measured cost to steering allows a soft robot small enough for these ducts to intervene as well as navigate.
Sources
Related papers
- Rethinking Actions: Continuity-Aware Priors for World-Model Planning
- MOSAIC: Modular Obstacle and Spatial-Aware Framework for Manipulation In Cluttered Scenes
- SAGAS: Semantic-Aware Graph-Assisted Stitching for Offline Temporal Logic Planning
- DexSeed: Expanding Human Hand-Object Interactions into Robot Demonstrations for Dexterous Policy Learning
- LaST0.5: A Generalist World Action Model with Interaction-Centric Latent Reasoning
- CIALLO: Learning Shared Intent Representations for Cross-Embodiment Manipulation