Learning Latent Volumetric Dynamics for Multimodal Goal-Conditioned Robot Manipulation of Hair
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.
Rosa: We're looking at the paper: "Learning Latent Volumetric Dynamics for Multimodal Goal-Conditioned Robot Manipulation of Hair".
Title and authors: Rosa: So we're looking at this paper called "Learning Latent Volumetric Dynamics for Multimodal Goal-Conditioned Robot Manipulation of Hair." Basically, they're tackling hair care for robots, which is really hard because hair has this super fine physical structure and complex movement.
Dev: Yeah, the core idea here is introducing DYMO-HAIR, a model-based system. They’re proposing a new way to learn the dynamics of hair that works well with volumetric data, which is much better for capturing those detailed shapes than just using sparse point clouds.
Taro: It sounds like they are trying to get the robot to understand not just where the hair is, but how it flows locally. I mean, capturing both position and local strand flow at the same time gives them a lot more geometric detail about what's happening on a strand.
Rosa: Exactly. They represent hair as this high-resolution volumetric occupancy grid with a three dimensional orientation field so they can get dense supervision on both the hair's position and its local flow, which should give the model enough local signals to learn those fine deformations during training.
Dev: The key innovation they highlight is using a compact three dimensional latent space for different hairstyles that's pre-trained at scale, and then coupling that with an action conditioned state editing mechanism to handle the dynamics. That should help it generalize across different styles pretty well.
Taro: So they pre-train this latent space on a lot of diverse data, and then use that learned structure to control the hair's movement based on what the robot is doing at any given time in a way that's conditioned by the action. That sounds like it could be powerful for seeing how it handles something completely new.
Rosa: They also developed this hair-combing simulator based on Genesis, which uses a novel formulation of position based dynamics to simulate strand level contact rich hair simulation. This is crucial because they needed a way to generate large scale, visually realistic synthetic data without having to collect tons of real world data for the pre-training.
Dev: That PBD method they used for strand level simulation is what lets them create efficient, both visually realistic and physically plausible synthetic dynamics data across many different hairstyles, which supports their closed loop hair manipulation experiments. It's about making sure the simulated physics match what we expect in real life as much as possible.
Title and authors: Taro: I wonder how robust that PBD simulation is when you push it to handle really complex contact scenarios during the actual combing process. Also, they admit in their work that while it's efficient and realistic, they still fall short of achieving strand level physically accurate modeling.
Rosa: Right, so they acknowledge that the simulation is good but not perfect at the strand level physics yet. But for the robot itself, this means their system can do closed loop hair styling using a Model Predictive Path Integral planner to optimize a trajectory that gets it close to the visual goal.
Dev: That MPPI planner is what allows DYMO-HAIR to perform visual goal conditioned hair styling, so it takes those multi view RGB D observations and estimates the current volumetric state in real time. It's how it figures out where to move next.
Taro: And when the world misbehaves, like if there's a long wig case, they showed that this system can handle long horizon spatial transformations by pushing hair behind the ear to get that transformation done successfully. That’s a real-world capability we need to see demonstrated reliably.
Rosa: It also has some limitations, though. They mentioned an issue with the coupling between the twist constraint and gravity scheduling, where some strands seem to "float" instead of falling naturally because they're suspended unrealistically in their simulation.
Dev: That points to a physical modeling challenge, but they also noted that purely voxel level supervision lacks regularization to enforce geometric continuity, which might lead to small gaps or discontinuities in the final geometry. That's a structural weakness in how they supervise the model.
Taro: So when things go wrong, whether it's floating strands or those tiny gaps between voxels, it shows that the complexity of hair structure is still pushing the limits of their current physical modeling approach.
Rosa: They also talked about real world usability and time costs. A five step manipulation experiment takes about sixty minutes in the real world. And they pointed out that some failures happen because the strand level distance used for planning might not be precise enough to represent state differences, leading to incomplete styling within their step budget.
Title and authors: Dev: The time cost analysis shows that for a single manipulation, it takes about thirty seconds just for action planning and execution at each step. If you multiply that by the steps needed, it adds up quickly. They mentioned future work could involve incorporating gravity effects directly into the dynamics modeling to fix those floating strand issues.
Taro: And from a failure mode standpoint, they noted that motions that don't create enough friction between the combing tool and the head can cause hair to fall back due to gravity, which is another way things go sideways outside of just simulation artifacts.
Rosa: But on the positive side, they showed zero shot transferability to physical wigs in real world demonstrations, meaning it can successfully style challenging unseen hairstyles where other state of the art systems fail. That's a big win for generalizability.
Dev: They also compared their results against baselines and found that DYMO-Hair achieves an average of twenty two percent lower final geometric error and forty two percent higher absolute success rate than the state of the art system across three different test cases. That’s a solid quantitative improvement when you look at performance metrics.
Taro: And when looking at how it handles unseen styles, they found that their method achieves the second best performance on seen styles, only a small gap compared to V-UNet, but it outperforms all other methods on unseen ones with a larger margin. That shows both effectiveness and generalizability working together.
Rosa: So to wrap up this paper on "Learning Latent Volumetric Dynamics for Multimodal Goal-Conditioned Robot Manipulation of Hair," we have a unified model based robot hair care system that's visual goal conditioned, works in simulation and the real world, and is designed to be generalizable to novel hairstyles.
Dev: It introduces the first three dimensional hair combing dynamics model with this novel volumetric learning paradigm for generalizable dynamics modeling, along with a simulator using a novel PBD method for strand level simulation to generate the necessary data for large scale pre training.
Taro: The main point is that they've built a system that can handle complex physical structures and aim for real world goal condition hair styling, even when dealing with styles it hasn't seen before.
Rosa: That’s what it boils down to. It’s the first unified model based robot hair care system we have seen for visual goal conditioned styling that bridges simulation and reality.
The paper's summary: Rosa: So, to recap what we just heard, this paper introduces DYMO-HAIR as a unified system for robot hair care that works in both simulation and the real world, focusing on getting visually goal-conditioned styling right across different hair types.
Dev: Yeah, they’re using this new way of modeling volumetric hair dynamics based on learning latent states and then editing them based on the action being taken. It’s not just about where the hair is; it’s how it flows locally in a way that helps generalize to styles we haven't seen before.
Taro: What’s interesting to me is how they built their training data for this latent space, combining synthetic states with real hair data and even some deformed variants from a large existing dataset. They ended up with forty-seven thousand hair states, which seems like a solid foundation for learning those complex dynamics.
Rosa: And they didn't just stop at the dynamics model, they built this simulator too, using a position based dynamics method to make synthetic data that feels physically plausible for strand level combing. That’s a big step because getting good synthetic data is usually the hardest part of training these kinds of systems.
Dev: That simulator helps them generate large scale, visually realistic synthetic dynamics data across diverse hairstyles without needing to spend all their time collecting real world hair combing videos. It lets them test and train much faster.
Taro: But even with that simulation, they have to deal with the physics details, right? They mentioned some artifacts in the simulation where strands seem to float instead of falling naturally because of how they coupled the twist constraint with gravity scheduling. That’s a physical modeling snag.
Rosa: Exactly. And beyond just the simulation issues, their real world experiments show that DYMO-HAIR is actually quite effective when it comes to goal conditioned styling compared to all the other systems they tested against.
Dev: They achieved an average of twenty two percent lower final geometric error and forty two percent higher absolute success rate across three different test cases, which is a solid quantitative improvement over what was available at the time.
Taro: But the real win, for me, is the zero shot transferability to physical wigs. They showed it can consistently succeed on challenging unseen hairstyles where other systems just fail completely in the real environment. That’s a significant leap for deployment because it means it doesn't need a massive dataset of every possible hairstyle before it can work.
Rosa: So, what this really means is that we’ve got a system that isn't just good at styling hair we’ve seen, but one that has the learning structure to handle something totally new when it hits the real world.
Dev: It also showed they can handle long length wig cases successfully in the real world by doing things like pushing hair behind the ear to get a long horizon spatial transformation done. That shows some robustness in complex physical tasks.
Taro: But we still have those limitations mentioned, like that purely voxel level supervision doesn't have enough regularization for geometric continuity, which could mean small gaps appear in the final geometry of the styled hair. That’s a structural weakness they admit to.
Rosa: So it’s a system that performs incredibly well at learning and generalizing to new hair styles, but we still have some fine tuning needed on the underlying physical modeling and data supervision.
Dev: Right, so while the performance numbers are strong, the authors are honest about where the current physics modeling falls short when dealing with those tiny strand level details.
Taro: And for us listening, it means that if we want robots to interact with complex human items like hair in real life, we need a system that can learn from less data and still perform reliably on things it has never encountered before.
The paper's improvements: Rosa: So, to summarize what we just covered, this paper introduced DYMO-HAIR as a unified system for robot hair care that works in both simulation and the real world using a new way of modeling volumetric hair dynamics based on learning latent states.
Dev: Right, they showed it can do visual goal conditioned styling across different styles by using an action conditioned state editing mechanism coupled with this compact three dimensional latent space.
Taro: They also developed this simulator using a position based dynamics method to generate synthetic data for strand level combing, which is key because you need realistic physics data to train the AI effectively.
Rosa: The improvements they suggest focus on making that physical modeling more accurate and stable. They mentioned that the coupling between the twist constraint and gravity scheduling sometimes makes strands float unnaturally, so they want to incorporate gravity effects more directly into those dynamics models.
Dev: And they pointed out that when it comes to data supervision, purely voxel level methods lack regularization for geometric continuity, which can lead to those small gaps in the final hair geometry. They suggest using techniques from computer graphics to improve how they model the structure physically.
Taro: That's a practical point because if the underlying physical model isn't perfect, even a great latent space won't fix all of it when you actually deploy this on a real robot doing complex tasks.
Rosa: And for the real world aspect, they hinted at ways to make it more usable by enforcing action space constraints to avoid safety risks, like making sure the tool doesn't get too close to the eyes, and exploring softer, compliant tool designs instead of using rigid ones.
Dev: That makes sense because when you’re running a real time loop, safety is a huge concern. And they also hinted at optimizing the speed of things by looking into parallelization for state estimation and making the planning computation faster by incorporating parallelism into how they calculate strand level distance.
Taro: So it sounds like the next steps are really about taking this strong model and making it robust enough for real-world deployment, addressing those physical simulation glitches, and ensuring it stays safe while running in a fast control loop.
Conclusion: Rosa: So, to wrap up, this paper introduces DYMO-HAIR as a unified system for robot hair care that works in both simulation and the real world by learning volumetric dynamics based on latent states.
Dev: They proved it can do visual goal conditioned styling across different styles by using an action conditioned state editing mechanism coupled with this compact three dimensional latent space.
Taro: They also developed this simulator using a position based dynamics method to generate synthetic data for strand level combing, which is key because you need realistic physics data to train the AI effectively.
Rosa: The improvements they suggest focus on making that physical modeling more accurate and stable. They mentioned that the coupling between the twist constraint and gravity scheduling sometimes makes strands float unnaturally, so they want to incorporate gravity effects more directly into those dynamics models.
Dev: And they pointed out that when it comes to data supervision, purely voxel level methods lack regularization for geometric continuity, which can lead to those small gaps in the final hair geometry. They suggest using techniques from computer graphics to improve how they model the structure physically.
Taro: That's a practical point because if the underlying physical model isn't perfect, even a great latent space won't fix all of it when you actually deploy this on a real robot doing complex tasks.
Rosa: And for the real world aspect, they hinted at ways to make it more usable by enforcing action space constraints to avoid safety risks, like making sure the tool doesn't get too close to the eyes, and exploring softer, compliant tool designs instead of using rigid ones.
Dev: That makes sense because when you’re running a real time loop, safety is a huge concern. And they also hinted at optimizing the speed of things by looking into parallelization for state estimation and making the planning computation faster by incorporating parallelism into how they calculate strand level distance.
Taro: So it sounds like the next steps are really about taking this strong model and making it robust enough for real-world deployment, addressing those physical simulation glitches, and ensuring it stays safe while running in a fast control loop.
Rosa: Exactly. The paper on "Learning Latent Volumetric Dynamics for Multimodal Goal-Conditioned Robot Manipulation of Hair" gives us a solid foundation for tackling complex human interactions with robots like hair styling.
Dev: It’s a unified approach that bridges the gap between high-level learning and low-level real time control, which is something we always look at when designing these systems.
Taro: I just think the zero shot transferability to physical wigs is what really matters for autonomy research because it shows the system learns general hair principles rather than memorizing specific styles.
Rosa: It does mean that if we want robots to interact with complex human items in real life, we need a system that can learn from less data and still perform reliably on things it has never encountered before.
Chengyang Zhao, Uksang Yoo, Arkadeep Narayan Chaudhury, Giljoo Nam, Jonathan Francis, Jeffrey Ichnowski, Jean Oh
Robotics Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA. · Epic Games, Inc., Pittsburgh, Pennsylvania, USA. · Meta Codec Avatars Lab, Pittsburgh, Pennsylvania, USA. · Bosch Center for Artificial Intelligence
cs.RO
Submitted: 2025-10-07
Updated: 2026-11-16
Comments: Extended version of the previous work in ICRA 2026. Project page: https://dymohair.github.io/
Code: https://github.com/Genesis-Embodied-AI/Genesis
Project page: https://dymohair.github.io
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Importance score: 90/100
The gist: Hair care is an essential daily activity, yet it remains inaccessible to individuals with limited mobility and challenging for autonomous robot systems due to the finegrained physical structure and…
Key concepts
- Volumetric Occupancy Grid with Orientation Field
- Hair is represented as a high-resolution 3D grid that tracks both where each part of the hair is located (occupancy) and how it's oriented. This detailed representation captures the fine geometric structure and local strand flow of hair, providing rich information for modeling complex deformations during learning.
- Action-Conditioned State Editing
- This is a new way to learn dynamics where the robot's actions directly influence how the hair state changes. By conditioning the state editing on specific actions, the system learns a more general and robust model, making it better at handling diverse hairstyles it hasn't seen before.
- Model Predictive Path Integral (MPPI) Planner
- This is a planning algorithm used by DYMO-HAIR to decide the best sequence of movements. It uses the learned dynamics model to predict future hair states based on different action choices, optimizing the path to reach the desired hairstyle goal while minimizing geometric errors.
Terminology
Summary
Hair care is an essential daily activity, yet it remains inaccessible to individuals with limited mobility and challenging for autonomous robot systems due to the finegrained physical structure and complex dynamics of hair This work presents DYMO-HAIR, a model-based robot hair care system It introduces a novel dynamics learning paradigm that is suited for volumetric quantities such as hair, relying on an action-conditioned latent state editing mechanism, coupled with a compact 3D latent space of diverse hairstyles to improve generalizability Using the dynamics model with a Model Predictive Path Integral (MPPI) planner, DYMO-HAIR is able to perform visual goal-conditioned hair styling Experiments in simulation demonstrate that DYMO-Hair’s dynamics model outperforms baselines on capturing local deformation for diverse, unseen hairstyles
Dynamics Modeling Paradigm
The authors propose a novel paradigm for generalizable volumetric hair dynamics modeling They represent hair as a high-resolution volumetric occupancy grid with a 3D orientation field to capture both hair position and local strand flow, which offers more geometric details and structural information of hair than sparse point clouds This representation allows for dense supervision on both occupancy and orientation, providing sufficient local signals for the model to capture fine-grained deformations during learning The key innovation involves pre-training a compact 3D latent space for diverse hair states and introducing a control branch that models dynamics as actionconditioned state editing, enabling significantly improved generalizability through large-scale pre-training
Data Generation and Simulation
To avoid time-consuming real-world data collection required by the pre-training, they developed a hair-combing simulator based on Genesis This simulator leverages a novel formulation of the position-based dynamics (PBD) method for strandlevel, contact-rich hair simulation, enabling efficient largescale generation of visually-realistic and physically-plausible synthetic dynamics data across diverse hairstyles The simulator uses a novel PBD method for strandlevel hair simulation to enable efficient, both visually-realistic and physicallyplausible simulation of contact-rich hair-combing dynamics, supporting synthetic data generation and closed-loop hair manipulation experiments
System Implementation
DYMO-HAIR is a unified, model-based robot hair care system for visual goal-conditioned hair styling It adopts a Model Predictive Control (MPC) framework, using a Model Predictive Path Integral (MPPI)-based planner to optimize an action trajectory that minimizes the geometric distance between predicted hair states and the objective The system takes multi-view RGB-D observations from the environment and estimates the current volumetric hair state, following [34]
Experimental Results
Simulation experiments on diverse unseen hairstyles show that DYMOHair achieves superior effectiveness and generalizability for closed-loop hair styling compared to all system baselines, with an average of 22% lower final geometric error and 42% higher absolute success rate than the state-of-the-art system Real-world demonstrations further exhibit zero-shot transferability of DYMO-Hair to physical wigs, achieving consistent success on challenging unseen hairstyles where the state-of-the-art system fails
Limitations and Future Work
One issue arising from the coupling between the twist constraint and the gravity scheduling mechanism is that some strands appear to “float” rather than fall naturally due to unrealistic suspended strands Another limitation is that purely voxel-level supervision lacks regularization to enforce geometric continuity, which may lead to small gaps or discontinuities in end-state geometries Future work may incorporate advances from recent research in computer graphics to improve structural and physical modeling of hair for more physically-accurate and stable hair simulation
System Efficiency Analysis
In the real world, a 5-step manipulation experiment takes approximately 60 minutes in total Potential future optimizations include reducing redundant views, faster state estimation through parallelization and GPU-accelerated computation, and faster planning computation through incorporating parallelism into the strand-based distance computation The current focus is on closing the loop to enable effective model-based hair manipulation, where the current system demonstrates strong closed-loop hair styling capability
Failure Mode Analysis
The complex physical structure and high degrees of freedom of hair can sometimes make this cost insufficient to fully represent state differences, leading to incomplete styling within the step budget Motions that fail to create sufficient occlusion or friction between the hair and head may result in hair falling back due to gravity The contact among the combing tool, the head, and the hair remains challenging, as inaccuracies in calibration may result in insufficient contact allowing fine strands to slip through small gaps
Evaluation Metrics Definition
For fair comparison, they convert outputs of all volumetric methods into point clouds with per-point orientations and down-sample them to the same resolution as PC-GNN Three metrics are used for evaluation: Point-level Chamfer Distance CDpoint, Errori, and CDstrand The strand-level Chamfer Distance is then defined by averaging over both directions
Generalizability Comparison
The results show that V-UNet fits the training distribution best but fails to generalize well to unseen hairstyles In contrast, their method achieves the second-best performance on seen hairstyles, with only a small gap compared to V-UNet, while outperforming all other methods on unseen hairstyles with a larger margin This demonstrates both the effectiveness and the generalizability of their approach
Hierarchical Structure Ablation
The hierarchical structure allows the model to learn a stronger latent space, achieving higher reconstruction accuracy on both seen and unseen hairstyles, and leading to improved dynamics learning performance The results demonstrate that the pretrained latent space generalizes well to unseen hairstyles with deformations
Qualitative Results Summary
In some cases, the system does not fully complete the styling within the given 15-step budget, leaving a slight gap between the end state and the goal state, which would require additional planning steps to close These results complement Fig. 7 and further demonstrate the generalizability and effectiveness of their system on visual goal-conditioned hair styling
Training Data Construction
For latent space pre-training, they combine synthetic hair states with deformed variants from their dataset and an existing large-scale neat hairstyle database, yielding 47K hair states to build a strong and representative latent space Dynamics learning is then trained on their 10K combing dataset
Comparison Against Baselines
DYMO-Hair achieves the best performance, with an average of 22% lower final geometric error and 42% higher absolute success rate across three cases (using thresholds of 0.90, 0.70, and 0.70, chosen as reasonable success criteria based on experiments and visualization) Among them, DYMO-Hair achieves the best performance
Final Conclusion
This paper presents the first study on model-based robot hair manipulation They introduce the first 3D hair-combing dynamics model with a novel volumetric learning paradigm for generalizable dynamics modeling They also develop a simulator with a novel PBD method for strand-level, contact-rich hair-combing simulation to support data requirements for large-scale pre-training Together, these contributions yield the first unified model-based robot hair care system, DYMOHair, for visual goal-conditioned hair styling, generalizable to novel hairstyles and evaluated in both simulation and the real world
Simulation Artifacts
One issue arises from the coupling between the twist constraint and the gravity scheduling mechanism (introduced in Sec. IX-B), for example, as shown in row 4, column 7 of Fig. p. 2 11, some strands appear to “float” rather than fall naturally Another limitation is from the PBD-based collision handling, where each strand is represented as a collection of particles
Time Cost Analysis Details
In the real world, a 5-step manipulation experiment takes approximately 60 minutes in total For each multi-view observation, the system perform dense capturing: the robot takes 3 seconds to move and capture each view, resulting in 56 views collected in about 3 minutes The subsequent state estimation takes around 4 minutes For each action step, the system computes the action planning in approximately 2.5 minutes and executes it in 30 seconds
System Time Cost Analysis
The current time cost is approximately 60 minutes for a 5-step manipulation experiment in the real world Potential future optimizations include reducing redundant views, faster state estimation through parallelization and GPU-accelerated computation, and faster planning computation through incorporating parallelism into the strand-based distance computation The overall time cost reveals several opportunities to further accelerate the system through targeted engineering improvements
Failure Mode Analysis Summary
Failures in closed-loop manipulation may also arise from other system-level factors The strand-level distance as the MPPI planning cost can sometimes be insufficient to fully represent state differences, leading to incomplete styling within the step budget Motions that fail to create sufficient occlusion or friction between the hair and head may result in hair falling back due to gravity The contact among the combing tool, the head, and the hair remains challenging, as inaccuracies in calibration may result in insufficient contact allowing fine strands to slip through small gaps between the tool and the head
Conclusion Summary
This paper presents DYMO-HAIR, a unified, model-based robot hair care system for visual goal-conditioned hair styling, generalizable to novel hairstyles and evaluated in both simulation and the real world They introduce the first 3D hair-combing dynamics model with a novel volumetric learning paradigm for generalizable dynamics modeling They also develop a simulator with a novel PBD method for strand-level, contact-rich hair-combing simulation to support data requirements for large-scale pre-training Together, these contributions yield the first unified model-based robot hair care system, DYMOHair, for visual goal-conditioned hair styling The paper is 2510.06199.
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Precision in dynamics modeling can be enhanced by using a novel learning paradigm that is
action-conditioned state editing mechanism, coupled with a compact 3D latent space of diverse hairstyles to improve generalizability.
This allows the system to performvisual goal-conditioned hair styling
across previously unseen styles. -
The system can achieve superior effectiveness in closed-loop hair styling by demonstrating an
average of 22% lower final geometric error and 42% higher success rate than the state-of-the-art system.
This capability is achieved by adopting aModel Predictive Path Integral (MPPI) planner
to optimize an action trajectory. -
Zero shot transferability to physical wigs can be achieved, allowing the system to exhibit
consistent success on challenging unseen hairstyles where the state-of-the-art system fails.
This means the robot can successfully style hair it has never seen before in a real environment. -
The system can generalize across diverse environments by leveraging a
novel PBD method for strand-level, contact-rich hair-combing simulation
to generate synthetic data that enablesefficient largescale generation of visually-realistic and physically-plausible synthetic dynamics data across diverse hairstyles.
-
The AI system can perform 3D state estimation from multi view RGB D observations by capturing
RGB D observations at 1280×720 resolution from 56 viewpoints around the hair, estimating 2D orientation maps for each, and reconstructing the 3D hair state following [34].
-
The system can execute long horizon spatial transformations in real-world scenarios, as demonstrated by its ability to handle
long-length wig case where success requires pushing hair behind the ear to achieve a long-horizon spatial transformation.
-
The system can perform closed loop re planning and repeated retries to approach the goal, which is effective but not optimal, leading to improvements in styling efficiency through future work that could
incorporate gravity effects directly into the dynamics modeling.
-
The system can improve real world usability by exploring modifications such as
enforcing actionspace constraints to avoid safety-critical regions like the eyes
and replacing the current tool withsofter, compliant tool designs [6], [45].
Sources
- Inclusion in Assistive Haircare Robotics: Practical and Ethical Considerations in Hair Manipulation
- RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Tools
- Particle-Grid Neural Dynamics for Learning Deformable Object Models from RGB-D Videos
- Diffusion Dynamics Models with Generative State Estimation for Cloth Manipulation
- RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects with Graph Networks
- Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling
- Controlling Deformable Objects with Non-negligible Dynamics: a Shape-Regulation Approach to End-Point Positioning
- Learning Mesh-Based Simulation with Graph Networks
- AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulation
- Combing a double helix
- HairFormer: Transformer-Based Dynamic Neural Hair Simulation
- Motion Prompting: Controlling Video Generation with Motion Trajectories
- MOSAIC: Generating Consistent, Privacy-Preserving Scenes from Multiple Depth Views in Multi-Room Environments
- Focal Loss for Dense Object Detection
- SAM 2: Segment Anything in Images and Videos
- Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection
- Segment Anything
- Augmented Mass-Spring model for Real-Time Dense Hair Simulation
- Digital Salon: An AI and Physics-Driven Tool for 3D Hair Grooming and Simulation
Related papers
- Rethinking Actions: Continuity-Aware Priors for World-Model Planning
- MOSAIC: Modular Obstacle and Spatial-Aware Framework for Manipulation In Cluttered Scenes
- SAGAS: Semantic-Aware Graph-Assisted Stitching for Offline Temporal Logic Planning
- DexSeed: Expanding Human Hand-Object Interactions into Robot Demonstrations for Dexterous Policy Learning
- LaST0.5: A Generalist World Action Model with Interaction-Centric Latent Reasoning
- CIALLO: Learning Shared Intent Representations for Cross-Embodiment Manipulation