Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree

summary

The gist

Modular soft magnetic robotic catheter enables multifunctional, autonomous navigation and therapy in millimeter-scale anatomy<ref:2601.14837#pg2> This work establishes a scalable platform for…

In short

A modular soft robotic catheter was developed for autonomous navigation and therapy within millimeter-scale anatomy like the pancreaticobiliary tree. The system integrates sensing, actuation, and therapeutic capabilities into a versatile platform. It uses AI vision and magnetic steering to achieve precise insertion, enabling complex endoluminal interventions with reduced operator burden.

Key concepts

Modular Architecture
The catheter is designed with up to four independent functional modules that can be combined for different tasks like anchoring, sensing, manipulation, or drug delivery. This modularity allows the same physical device to be customized for various clinical needs and procedures.
Autonomous Navigation Pipeline
This system uses a closed-loop control strategy combining a learned model (YOLOv8), magnetic steering, and shape sensing. It analyzes endoscopic video to detect anatomical features like papillae and markers, calculating the required deformation to guide the catheter autonomously toward its target.
Ultrasound-Triggered Drug Release
A micropatterned PLA coating surrounds the catheter tip. This coating is designed to release therapeutic agents only when triggered by a specific 1 MHz acoustic signal, ensuring on-demand drug delivery while remaining safe and inert during standard imaging ultrasound (7–28 MHz).
Hardware Agnosticism
The platform is designed to be compatible with various external systems. It can be deployed using standard clinical tools and operated by any magnetic manipulation system, whether using permanent or electromagnetic magnets, making it adaptable to different setups.

Terminology used across episodes

This episode discusses

The paper

Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree · Read on arXiv

B. Calmé, N. J. Greenidge, A. Metcalf, A. Bacchetti, G. Loza, D. Kpeglo, P. Lloyd, V. Pensabene, J. H Chandler, P Valdastri

STORM Lab, University of Leeds Institute of Medical Research at St James’ University Hospital, University of Leeds

Diagnosis and therapy in the pancreatobiliary tree are limited by access. Guidewires reach deep into the ducts but are blind, whereas cholangioscopes provide vision but are too large to readily enter the pancreatic body and tail, the cystic duct, or the gallbladder. At the millimeter scale of these ducts, every function added to a steerable catheter competes with steering for cross-section and adds bending stiffness. We present a 1.47-mm modular magnetic soft robotic catheter in which each function is built into the magnetic body, onto its surface, or onto the footprint of the camera, and we measured what each function costs in bending under bedside fields. Imaging and fiber Bragg grating (FBG) shape sensing accounted for most of this cost, whereas a compliant gripper, magnetic anchoring balloons, and a micrometer-thick ultrasound-triggered release shell together reduced the tip angle at 8 mT only from 70° to 64°. The anchoring balloon increased the gripping force about threefold without stiffening the catheter during navigation. In live pigs, the robotic catheter performed operator-initiated task-autonomous cannulation of the native papilla without sphincterotomy and was teleoperated under onboard vision 75 mm into the pancreatic duct and, without a guidewire, through the cystic duct into the gallbladder, whose lumen it imaged. Anchoring, grasping, and payload release were each demonstrated in vivo. Adding each function at a measured cost to steering allows a soft robot small enough for these ducts to intervene as well as navigate.

Transcript

Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.

Rosa: We're looking at the paper: "Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree".

Dev: Here's the gist of the paper. Modular soft magnetic robotic catheter enables multifunctional, autonomous navigation and therapy in millimeter-scale anatomy<ref:2601.14837#pg2> This work establishes a scalable platform for multifunctional soft robotic catheters and introduces a new paradigm for complex endoluminal interventions<ref:2601.14837#pg4> The paper presents a 1.47-mm-diameter modular soft robotic catheter that integrates sensing, actuation, and therapeutic capabilities while retaining the compliance needed for safe endoluminal navigation<ref:2601.14837#pg3> This platform is hardware-agnostic, being deployable through standard clinical tools and actuated via any magnetic manipulation system, either using permanent or electro-magnet<ref:2601.14837#pg4> The device can be configured with up to four independent functional modules, including onboard imaging, a tendondriven compliant gripper, tunable magnetic anchoring balloons, and ultrasound-triggered drugrelease coatings<ref:2601.14837#pg4> System Architecture and Modularity The modular architecture supports up to four independently controlled functional units, enabling customizable combinations of anchoring, manipulation, sensing, and targeted drug delivery<ref:2601.14837#pg4> The catheter body integrates 100-µm microchannels, a miniature camera with LED illumination, and markers for pose estimation within the 1.47-mm outer diameter<ref:2601.14837#pg3> Magnetic actuation was achieved by a large external permanent magnet (EPM) mounted onto a 7-DOF robotic manipulator positioned at the patient’s bedside<ref:2601.14837#pg5> The operator interface integrates two joysticks (one for EPM pose, one for module actuation), an automated advancing unit for feed/retraction, and a computer-controlled insufflation system<ref:2601.14837#pg5> Navigation and Control Strategy A closed-loop autonomous/shared-control system, combining a learned model, magnetic actuation, onboard shape sensing, and visual marker tracking, further enhances cannulation accuracy<ref:2601.14837#pg2> The autonomous control pipeline couples a YOLOv8 detection algorithm with a magnetic steering model and an FBG shape sensor to perform insertion<ref:2601.14837#pg9> The detector identifies the papilla and two mSCR tip markers from endoscopic video and estimates the tip orientation, achieving a precision of 0.81, recall of 0.76, and an F1 score of 0.78<ref:2601.14837#pg10> The angular error relative to the desired entry line is mapped to a desired deformation, which a dipole–dipole magnetic model converts into an EPM pose<ref:2601.14837#pg10> Functional Module Validation The compliant gripper enabled reliable object and tissue grasping in bench and in vivo experiments<ref:2601.14837#pg8> Peak gripping force without anchoring was 0.43 ± 0.06 N, which increased to 1.28 ± 0.16 N when combined with the anchoring balloon, a 300% improvement<ref:2601.14837#pg8> The micropatterned PLA shell provides on-demand therapeutic release under a 1 MHz acoustic trigger while remaining inert under standard imaging ultrasound (7–28 MHz)<ref:2601.14837#pg6> In vivo trials validated successful on-demand release after navigation across the bile duct, as well as in the gastrointestinal tract and the lung<ref:2601.14837#pg6> Biocompatibility and Safety The biocompatibility analysis showed that there was no significant difference in the metabolic activity of cells between conditions for a 24-hour exposure time<ref:2601.14837#pg25> The results showed no significant difference in the metabolic activity of the cells between the different conditions for a 24-hour exposure time<ref:2601.14837#pg25> By uniting magnetically enabled shape control with task-level functionality, imaging, manipulation, anchoring, and on-demand therapy, this platform advances soft robotic catheters towards practical clinical impact<ref:2601.14837#pg11> The system supports both exploratory open-loop navigation (enabled by on-board vision) and autonomous navigation for planned procedures<ref:2601.14837#pg10> This approach aims to reduce reliance on ionizing radiation, shorten the learning curve for complex navigation (e.g., ERCP), and provide a blueprint for procedure-specific modularity<ref:2601.14837#pg11> The work demonstrates that a magnetic catheter can be used safely in a highly sensitive environment and, in the context of ERCP, potentially help reducing a major cause of long-term side effects for patients<ref:2601.14837#pg11> Materials and Methods Soft robotic catheter bodies were produced by low-pressure injection molding using high-resolution molds<ref:2601.14837#pg13> The magneto-elastic matrix consisted of a 1:1 mass mixture of neodymium-iron-boron powder with 5 µm particles and DragonSkin 30 silicone that was mixed and degassed in a planetary mixer<ref:2601.14837#pg13> The compliant gripper is inspired by a flexure-based L-arm mechanism in which a central shuttle translates relative to a fixed base to close the jaws<ref:2601.

Title and authors: Rosa: We've been talking about the modular magnetic soft robotic catheter enabling visualized intervention in the pancreatobiliary tree, and now we’re diving into what that actually means for complex procedures. This paper proposes a new way to approach endoluminal interventions by using these small, flexible devices to navigate and then perform tasks like imaging or therapy inside areas like the pancreas and bile ducts.

Dev: It sounds like they're moving beyond just navigating passively; they’re talking about delivering clinically actionable functions right there in the procedure.

Taro: I'm looking at how they tackle the navigation problem because that’s usually the hardest part in these delicate spaces, right?

Rosa: That’s where their closed-loop control strategy comes into play, combining onboard shape sensing with real-time tracking based on a convolutional neural network model for autonomous insertion.

Dev: So it uses computer vision from the video feed to guide itself toward the target anatomy without needing constant manual steering input.

Rosa: Precisely, and they achieve this by mapping the angular error relative to where it should go into a desired deformation, which they then convert into a magnetic pose for an external permanent magnet.

Taro: That sounds like a real step away from just having the surgeon manually guide the tip through the duct.

Dev: It is, and they found that this autonomous control pipeline couples a YOLO v8 detection algorithm with that magnetic steering model and fiber Bragg grating shape sensor to perform insertion.

The paper's summary: Rosa: So what's the core of what they achieved in "Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree"? They built a miniaturized, multifunctional soft robotic catheter that integrates sensing, actuation, and therapeutic capabilities while keeping the compliance needed for safe endoluminal navigation.

Dev: It’s important to understand that this isn't just about navigation; it’s about making the catheter functional in multiple ways. They can configure up to four independent functional modules on this platform.

Taro: I'm interested in those modules because they sound like they could do a lot of different things, from grasping tissue to releasing drugs.

Rosa: Yes, for example, you have an onboard imaging system with an LED illumination, a tendondriven compliant gripper for grasping objects or tissue, tunable magnetic anchoring balloons for stabilization, and ultrasound-triggered drug release coatings.

Dev: The modular architecture supports up to four independently controlled functional units so you can choose the right combination of anchoring, manipulation, sensing, and targeted drug delivery based on the specific procedure.

Rosa: And they validated these functional modules in experiments; for instance, the compliant gripper showed a peak gripping force of zero point forty-three Newtons without anchoring balloon and it jumped to one point twenty-eight Newtons when combined with that balloon, which is about a three hundred percent improvement.

The paper's improvements: Dev: Looking at the proposed improvements, one major thing they highlight is the enhanced manipulation stability achieved by combining that degree of machine intelligence with an autonomous insertion strategy and a magnetic balloon for stabilization.

Taro: So, when the world misbehaves or things get slippery during insertion, does this system handle it better than a purely manual approach?

Dev: Yes, they found that this combination resulted in a mean insertion time of two hundred twenty-three plus or minus ten seconds across two porcine models compared to two hundred fifty-three plus or minus twenty three seconds when an operator was controlling the system.

Rosa: That's a solid improvement in terms of speed and reliability, and it really shows how machine intelligence can help reduce the operator burden during this critical cannulation phase.

Taro: What about those therapeutic aspects? Are they just theoretical releases, or did they actually work in a relevant setting?

Dev: They have validated on-demand release using micropatterned PLA coating around the mSCR with a designed micropattern that resonates near one megahertz, allowing for drug release triggered by insonation while remaining inert under standard imaging ultrasound at seven to twenty eight megahertz.

Rosa: And those in vivo trials confirmed successful on-demand release after navigating across the bile duct, as well as inside the gastrointestinal tract and even the lung.

Conclusion: Rosa: So to wrap up this discussion on "Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree", what we have is a platform that unites magnetically enabled shape control with task-level functionality, imaging, manipulation, anchoring, and on-demand therapy.

Dev: It really advances soft robotic catheters toward practical clinical impact by supporting both exploratory open-loop navigation enabled by onboard vision and autonomous navigation for planned procedures.

Taro: I'd add that this approach aims to reduce reliance on ionizing radiation and shorten the learning curve for complex navigation, like in an ERCP procedure, which is a huge consideration.

Rosa: They’re showing that a magnetic catheter can be used safely in a highly sensitive environment, and specifically in the context of ERCP, it could potentially help reduce major causes of long-term side effects for patients.

Dev: It’s an interesting platform because it offers flexibility; they are showing a blueprint for procedure-specific modularity that can adapt to different needs.

Taro: The paper shows that when you combine magnetic shape control with task functionality, you get a system that is both safe enough and versatile enough for complex internal work.

Rosa: And we'll keep an eye on how this technology moves from the lab bench into actual clinical settings after this deep dive into the "Modular magnetic soft robotic catheter enables visualized intervention in the pancreatobiliary tree".

More episodes

← Home