Higher-Order Morphology Priors for Quadruped Reinforcement Learning Under Actuator Degradation

arXiv:2610.10934 · cs.RO, cs.LG · Submitted 2026-10-07 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.

Rosa: Today's paper: "Higher-Order Morphology Priors for Quadruped Reinforcement Learning Under Actuator Degradation".

Dev: The gist The node-edge-face Hodge actor achieves the highest return on unseen actuator degradations, with higher survival and lower velocity-tracking error.

Rosa: First, who's behind it and why it matters.

Title and authors: Rosa: So we're looking at this paper called "Higher-Order Morphology Priors for Quadruped Reinforcement Learning Under Actuator Degradation" and the authors are You, Shamsi, Wang, and Allen-Blanchette. They’re tackling how robots learn to walk when their motors start failing.

Dev: It sounds like they're moving beyond just looking at the robot as a simple graph of joints and links. I mean they're trying to explicitly model the mechanical structure in a way that captures more than just direct connections between parts.

Taro: Exactly, because when an actuator degrades, it turns into a coordination problem where the remaining joints have to compensate for what they lost, and this representation should help guide that compensation.

Rosa: Right. They propose using something called a cell complex to represent the Unitree Go1 robot, specifically using rank-two cells that encode limb-level and body-level structures, and then applying Hodge-based message passing over nodes, edges, and faces to see how that helps <ref:2610.10934#pg1>.

Dev: So they're taking those joints as nodes, the couplings as edges, and adding these faces which represent mechanical units like whole legs or body sections. That’s a big step away from just looking at the links in isolation.

Taro: And the core idea is that by modeling it this way, you get multi-joint units explicit instead of them just being hidden inside those bounding edges, which should give the AI a much better sense of how things are physically connected.

Rosa: The main thing they show is that under degraded training—where actuators are scaled down by some factor rho i from zero to one—the node-edge-face Hodge actor achieves the highest return on unseen actuator degradations, with higher survival and lower velocity-tracking error than other methods.

Dev: That’s a pretty strong claim because it's about unseen degradation data, which is what matters when you're dealing with real-world failure modes. They found that under degraded training, Hodge-F surpasses other methods and gets the highest episode return on held-out compound actuator degradation data.

Taro: That suggests that this higher-order morphology representation acts as a useful inductive bias for whole-body compensation when actuators are failing, which is what we really need for robust locomotion.

Rosa: Now, let's talk about what they suggest as improvements. They are essentially proposing this higher-order representation—the cell complex with rank-two cells and the Hodge actor—as a way to strengthen learning and generalization under body perturbations compared to just using standard graph policies <ref:2610.10934#pg1,learning and generalization under body perturbations>.

Dev: I see that they are using specific mathematical machinery here, like rank-zero states decoded by a shared actor head, and how those lower components map signals to incident lower-rank cells and back, which allows adjacent cells sharing a boundary to exchange information <ref:2610.10934#pg3,decoded by a shared actor head>.

Taro: That mechanism is what lets the higher-order structure communicate across different ranks, meaning the policy doesn't just look at what’s directly connected but also how those groups of joints are organized mechanically.

Title and authors: Rosa: And they show that when you do crossregime evaluation—moving from healthy training to degraded testing, or vice versa—the results change depending on the direction. For instance, in H to D, MLP-C gets the highest return initially under zero-shot degradation, but in D to H, Hodge-F achieves both the highest return and lowest velocity RMSE.

Dev: So what they're pointing to is that exposure to actuator degradation during training actually enables the node-edgeface policy to learn a broadly effective locomotion strategy instead of one that's only specialized for damaged conditions. That’s a key point about how learning happens under these different conditions.

Taro: It implies that modeling this higher-order structure helps the system learn coordination, not just nominal walking, which is what we want when the robot has to make up for lost power.

Rosa: So to wrap up on this paper, they show that while standard graph policies might be good for initial learning in a healthy regime, it’s the explicit modeling of mechanical structure via node-edge-face Hodge actor that gives them the edge when you have to deal with actuator degradation.

Dev: It really seems like the shift is from local morphological communication to coupling different ranks through incidence and Hodge operators, which is a significant way to handle complex dependencies.

Taro: For someone listening who only cares about walking on uneven ground, this means that if your robot’s motors start acting up, having a model that understands the whole limb structure helps it keep moving better than one that just sees individual joint failures.

Rosa: That’s the big picture—this paper supports higher-order morphology as a useful inductive bias for whole-body compensation under actuator degradation. We've covered how they set up this representation and what their specific performance numbers show in the degradation training regime.

Dev: It’s important to remember their limitation, though, because they mention that purely local morphological communication can bottleneck information propagation on harder tasks, which is something we have to watch out for when scaling these kinds of systems up.

Taro: That makes sense. If the coordination gets too complex for the message passing structure they've built, it might just stop propagating useful information efficiently across all those ranks.

Rosa: So that’s our take on "Higher-Order Morphology Priors for Quadruped Reinforcement Learning Under Actuator Degradation." It shows that explicitly modeling the higher-order mechanical structure of a robot with rank-two cells and using Hodge message passing leads to better performance when dealing with actuator degradation <ref:2610.10934#pg1>.

Dev: We saw that their node-edgeface actor achieved the highest return under degraded training, which points toward learning a robust strategy for whole-body compensation.

Taro: This suggests that for autonomy research, focusing on how these higher-order relations are structured is a direction worth exploring when robots need to adapt to unexpected physical damage or failure.

Rosa: We'll leave you with this paper on higher-order morphology and actuator degradation. Next up, we’ve got some work on retrieval-augmented vision models that deal with adapting to new situations in real time.

The paper's summary: Rosa: So, we're looking at how this paper uses higher-order structure to help robots walk when their motors start failing, and it shows that modeling those structures explicitly makes a big difference in how well they compensate for the damage.

Dev: Exactly. The core idea is taking the Unitree Go1 robot and representing it not just as a simple line of connected joints, but using these rank-two cells to define limb and body units, and then using Hodge message passing across those nodes, edges, and faces.

Taro: So the faces are key here because they make those whole leg or body structures explicit instead of just being hidden inside the lines connecting them. That structure is what the AI uses to understand mechanical coordination.

Rosa: Right. And this setup lets the policy learn how different parts of a limb relate to each other in a way that goes beyond simple direct connections between two joints. It’s about learning how a whole leg moves as one functional unit under stress.

Dev: The numbers are pretty telling, though. when they trained it in the degraded regime, where the motors were intentionally scaled down—that’s the training setting—the Hodge actor achieved the highest return on unseen actuator failures compared to other methods.

Taro: That's interesting because it shows that even when you don't know exactly which motor is broken beforehand, having that high-order structural knowledge helps the robot find a better way to walk under those unknown conditions. It’s about finding a broadly effective strategy for compensation.

Rosa: It’s not just about surviving a specific failure; it suggests this representation gives the AI an inductive bias for learning coordinated compensation, which is what you need when joints have to work together to make up for lost power.

Dev: I mean, we saw earlier that in the healthy training regime, a simpler MLP approach could be faster initially, but once you hit those degraded trials, Hodge-F just pulls ahead and keeps the best score.

Taro: That implies that the complexity of modeling mechanical structure pays off when you need to deal with real-world physical stress and adaptation. It moves the learning from just reacting to joint errors to understanding whole-body mechanics.

Rosa: And it’s not just about survival; they also found higher survival rates and lower velocity tracking error, which means the robot doesn't just stumble around; it moves more reliably when things go wrong.

Dev: So, what this really changes for us as engineers is that instead of designing specific fault-handling mechanisms for every possible joint failure mode, we could maybe just focus on how well the robot understands its own mechanical topology.

Taro: That's the implication—if you can give the AI a better map of how things are physically connected, it learns to coordinate compensation better automatically. It’s about learning coordination, not just reacting to joint failures one by one.

Rosa: So we’ve seen that while standard graph policies might start strong in healthy conditions, explicitly modeling higher-order morphology through that node-edge-face setup is what gives the system the edge when it has to handle actuator degradation.

Dev: It really boils down to how fast and robustly you can propagate information across those different ranks of mechanical units without getting bogged down by too much latency in the message passing.

Taro: That’s a fair point, though, because they did mention that if the coordination gets too complex for their message passing structure to handle efficiently, it can bottleneck the information flow across all those ranks.

Rosa: It stops propagating useful information if you push it too far into very complex coordination problems that the current cell structure can’t quite map out effectively.

Dev: So, we have a way to build better representations for physical structure, but we still need to make sure the message passing network itself is fast enough for real-time control loops when things get really messy.

Taro: That's the next hurdle—ensuring that this sophisticated structural understanding translates into low-latency action execution on the robot.

Rosa: We’ll keep an eye on that, because if we can make this higher-order modeling fast enough for deployment, it could be a huge step forward for making robots truly resilient in unpredictable environments.

The paper's improvements: Rosa: So, after we talked about how modeling structure helps compensation under failure, let's talk about what they suggest as improvements for this method.

Dev: They are pointing out that by using this node-edge-face actor, you get a policy that can learn coordinated compensation better than just looking at individual joint failures.

Taro: Right. The improvement here is moving the focus from local joint decisions to a higher level of structural understanding, which allows for better whole-body coordination when the actuators are compromised.

Rosa: It means we’re suggesting that this approach can give the AI a much stronger inductive bias for learning how different mechanical units need to cooperate under stress, not just how one joint needs to move.

Dev: And from a control standpoint, it’s about using these rank-two cells and the message passing to handle those complex dependencies between limb structures in a way that respects the actual mechanical constraints of the robot.

Taro: So what they are suggesting is that by modeling this higher-order morphology, you can get better performance when the robot has to find a new way to move when its motors start failing. It’s about learning a functional strategy rather than just reacting to broken parts.

Rosa: It shifts the problem from localized joint control to a more holistic, structural understanding of how the entire body functions as one system under duress.

Dev: The implication is that this kind of representation should help stabilize those control loops during degradation, reducing the chances of catastrophic failures in velocity tracking.

Taro: It also suggests that exposure to degradation training actually helps the policy learn a more broadly effective locomotion strategy, which is something we need when robots operate outside perfectly controlled lab settings.

Rosa: So, it’s about using this higher-order structure to build robustness into the learning process itself rather than just adding an external fault-handling layer on top of a standard controller.

Dev: We have to keep in mind their limitation here, though—they flag that if the coordination gets too complicated for their message passing network, it can bottleneck the information flow across all those ranks.

Taro: That’s the caveat—the structural model is powerful, but we still have to ensure the actual network architecture can handle that complexity without introducing unacceptable latency in real-time control.

Rosa: So, while they show a great result under degradation training for unseen failures, the future work seems to be focusing on making this structure robust enough for deployment where latency and scale matter a lot.

Dev: Exactly. The next step has to be bridging that gap between this high-level structural model and a low-latency, reliable control policy running on actual hardware.

Conclusion: Tom: So, to wrap up, we’ve seen how modeling the robot's structure through that node-edge-face Hodge actor helps it handle actuator degradation by learning coordinated compensation rather than just reacting to broken parts.

Rosa: It really shows that for field robotics, having a representation of the physical morphology that captures those limb and body units explicitly is a way to build real resilience into the AI's learning process.

Dev: From my side, it’s about getting that structural understanding into the control loop fast enough so we don't lose stability or hit latency issues when things start failing in the real world.

Taro: What this changes for autonomy is moving past simple joint-level fixes toward a whole-body strategy that anticipates damage and coordinates recovery across multiple body parts.

Rosa: It’s about using the actual mechanical layout of the robot as a powerful hint for how it should behave when things go wrong.

Dev: I just hope we can see this kind of structural awareness applied to other systems too, where we don't have such detailed physical models readily available for every single robot.

Taro: It opens up a new way to think about robustness—not just adding patches, but designing the learning agent with the right foundational structure from the start.

Rosa: So that’s what they did in "Higher-Order Morphology Priors for Quadruped Reinforcement Learning Under Actuator Degradation."

Dev: Yeah, it’s a solid piece of work on how to use complex topology to improve fault tolerance in embodied AI.

Taro: It provides a good baseline for thinking about how we can design these higher-order representations to be both effective and computationally efficient for deployment.

Princeton University

cs.RO, cs.LG

Submitted: 2026-10-07

Updated: 2026-10-07

Comments: Accepted to IROS Workshop BLPC 2026

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 78/100

The gist: The gist The node-edge-face Hodge actor achieves the highest return on unseen actuator degradations, with higher survival and lower velocity-tracking error.

Key concepts

Cell Complex Representation
The robot is represented as a cell complex where different ranks of cells explicitly encode mechanical structures. Rank-2 cells specifically capture limb-level structures and one body-level structure, making the robot's multi-joint nature explicit in the representation.
Hodge Message Passing
This is a method used to pass information across different levels (ranks) of the cell complex. It involves updating features within each rank (nodes, edges, faces) while exchanging information between adjacent ranks using learned mixing coefficients to balance same-rank and cross-rank communication.
Higher-Order Morphology
This refers to explicitly modeling mechanical structures beyond simple joints and links. Instead of just connecting joints (nodes and edges), the model uses higher-order cells like faces to represent complete mechanical units, such as a whole limb or the body structure.

Terminology

Summary

The gist The node-edge-face Hodge actor achieves the highest return on unseen actuator degradations, with higher survival and lower velocity-tracking error.

Higher-Order Morphology Representation

The paper investigates whether explicitly modeling higher-order mechanical structure can strengthen learning and generalization under body perturbations The Unitree Go1 is represented as a cell complex with rank-2 cells encoding four limb-level structures and one body-level structure, and Hodgebased message passing is applied over nodes, edges, and faces This representation makes multi-joint units explicit rather than leaving them implicit in their bounding edges

Multi-Rank Hodge Message Passing

The method utilizes a cell complex where nodes are joints, edges are serial couplings, and faces represent mechanical units Signals defined on rank-k cells are kcochains represented in networks by feature matrices Hk associated with nodes, edges, or faces Connectivity between adjacent ranks is encoded by the oriented incidence matrices B1 and B2 The message passing updates features within each rank while exchanging information across ranks through adjacent-rank incidence operators A learned mixing coefficient alpha(l)k balances same-rank messages with cross-rank messages The mixed message is passed through a learned norm gate and RMSNorm before a residual update The policy is defined as a tanh-transformed Gaussian distribution where µt,i and σt,i denote the mean and standard deviation for joint i Training involves two regimes: a healthy regime (H) with no actuator degradation and a degraded regime (D) where actuators are scaled by ρi in [0, 1] The results show that under the degraded regime training, Hodge-F eventually surpasses other methods and achieves the highest episode return

Performance Comparison

In in-regime evaluation (H → H and D → D), MLP-C improves rapidly early in training under both curricula and retains its lead under healthy regime training However, Hodge-F eventually surpasses other methods and achieves the highest episode return in the degraded regime D → D MLP-D and GCN ablate the sources of Hodge-F’s gain over MLP-C under D → D Crossregime evaluation shows that in H → D, MLP-C achieves the highest return, outperforming Hodge-F under zero-shot degradation Conversely, in D → H, Hodge-F achieves both the highest return and lowest velocity RMSE This suggests that exposure to actuator degradation during training enables the node-edgeface policy to learn a broadly effective locomotion strategy rather than one specialized only to damaged conditions

Conclusion

The centralized MLP remains strongest after healthy regime training, whereas degraded regime training shifts the advantage to Hodge-F This indicates that rank-2 limb and body structure matters most when the policy must learn compensatory coordination rather than nominal locomotion

--- Page 1 ---

Higher-Order Morphology Priors for Quadruped Reinforcement Learning Under Actuator Degradation Derek You∗1, Zafir Shamsi∗2, Keqin Wang∗†3 and Christine Allen-Blanchette†3 Abstract— Actuator degradation turns quadruped locomotion into a coordination problem requiring joints to compensate for lost actuation. Prior work suggests that morphology-aware graph policies improve learning and generalization under body perturbations. We ask whether these benefits can be strengthened by explicitly modeling higher-order mechanical structure. We represent the Unitree Go1 as a cell complex with limb- and body-level rank-2 cells and apply Hodge-based message passing. Under degradation training, the node-edge-face Hodge actor achieves the highest return on unseen actuator degradations, with higher survival and lower velocity-tracking error. These results support higher-order morphology as a useful inductive bias for whole-body compensation under actuator degradation. I. INTRODUCTION Learning-based controllers have made quadruped locomotion increasingly robust to terrain variation, uncertain dynamics, and changes in external loading [1, 2]. Actuator degradation instead directly reduces the control authority available at specific joints, requiring the remaining body to compensate. Existing fault-tolerant approaches address this challenge through explicit mechanisms for adapting to the fault [3–7]. This motivates the question: rather than adding dedicated fault-handling mechanisms, can robustness emerge simply from how the quadruped is represented in the policy? Morphology-aware policies show that representations of robot morphology shape locomotion and transfer [8–11]. Most such work encodes morphology as a classical graph, with joints as nodes and links as edges. At a higher level, joints form mechanical units such as limbs and body-level structures. Such a graph can represent the edges bounding these structures, but not the structures themselves as higherorder objects. We therefore ask whether enriching the graph with mechanically meaningful higher-order structure provides a useful inductive bias for coordinated compensation under actuator degradation. To investigate this question, we represent the Unitree Go1 as a cell complex whose rank-2 cells encode four limb-level structures and one body-level structure, and apply Hodgebased message passing over nodes, edges, and faces. The resulting faces make these multi-joint units explicit rather than leaving them implicit in their bounding edges. The main contributions of this work are twofold. (1) We introduce a higher-order morphology representation for the Unitree Go1 with mechanically motivated rank-2 limb and body cells, and a node-edge-face Hodge actor over it. (2)∗Equal contribution. 1Edison Academy Magnet School. 2South Brunswick High School. Work done during the Princeton Laboratory Learning Program. 3Princeton University. †Correspondence: keqin.wang, ca15@princeton.edu (b) (a) 0-cell 1-cell virtual 1-cell 2-cell Fig. 1: Go1 higher-order morphology. (a) The twelve actuated joints form the 0-cells; sixteen 1-cells give eight serial couplings, four around the hip ring, and four dashed virtual closures that let each leg bound a face. (b) The same cells at the true Go1 joint positions, with distant limbs faded. Only the node-edge-face actor propagates through rank-2 cells. Through a capacity-matched healthy/degradation trainingevaluation study, we show that our approach outperforms competitive baselines on held-out compound actuator degradation data.

--- Page 2 ---

19 Related work Learned quadruped locomotion.

Improvements for AI systems

  1. Bold header: Higher-Order Morphology Representation for Compensation

This system can explicitly model higher-order mechanical structure by representing the Unitree Go1 as a cell complex with limb- and body-level rank-2 cells, which makes multi-joint units explicit rather than leaving them implicit in their bounding edges.

  1. Bold header: Robustness Under Actuator Degradation

The improved AI system will exhibit superior performance under fault conditions, achieving the highest return when training in the degraded regime, as shown by the result where Hodge-F achieves the strongest performance under degradation.

  1. Bold header: Coordinated Compensatory Control

By using node-edge-face Hodge actor, the policy can learn coordinated compensation for lost actuation, leading to improved higher survival and lower velocity-tracking error.

Sources

Related papers