LaST0.5: A Generalist World Action Model with Interaction-Centric Latent Reasoning
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.
Rosa: We're looking at the paper: "LaST0.5: A Generalist World Action Model with Interaction-Centric Latent Reasoning".
Title and authors: Rosa: So we're talking about LaST0 point 5 today <ref:2611.14048#pg1>. It’s this new World Action Model that the researchers put out at arXiv. It aims to solve a problem they see in existing world action models: they get really good at modeling the whole scene but they don't always focus enough on what the robot is actually doing with local objects, which is crucial for manipulation.
Dev: Right, so it’s about bridging that gap between understanding the big picture and figuring out how to move things precisely. The authors call this approach Interaction-Centric Latent Reasoning or ICLR, which they use to build a compact latent space under supervision from visual interaction cues like motion and object affordance.
Taro: But what I’m wondering is how they actually manage that interaction focus when the model is trained on so much data for world evolution? How do you make sure it doesn't just get lost in the noise of global scene representations?
Rosa: That’s a good question, Taro. They handle this by setting up a hierarchical reasoning structure. It starts with the world expert predicting future scene representations, and then that prediction is fed into the latent expert, which learns to focus on those specific interaction regions where manipulation happens.
Dev: And they do this by building these interaction-centric latent targets from individual frames using a frozen vision tower to get patch tokens, which are then aggregated into a single representation. The joint training objective balances three losses: one for the world modeling, one for that latent space learning, and one for the action generation itself.
Taro: So it’s like they’re teaching it to look not just at the whole room, but specifically at where the robot's hand is going and what the object affords them?
Rosa: Exactly. They also have this thing called Adaptive World-to-Action Transfer, or AWAT. This mechanism dynamically adjusts how long the robot plans its actions by looking at predicted progress values from those future frames, using something they call progress consistency to trigger resampling when things look like they need a change in direction.
Title and authors: Dev: That’s a clever way to manage the execution horizon without needing a separate, massive planning step for every single action. It essentially tells the system when it's safe to stop or adjust its current plan based on what it expects next.
Taro: I saw some of the results on LIBERO and RLBench, and they claim ninety-nine point five percent success on LIBERO <ref:2611.14048#pg2>. Is that number realistic when you're dealing with real-world physics outside of a perfect simulation?
Rosa: Well, the paper reports that they achieved ninety-nine point five percent on the LIBERO benchmark, which is pretty high for this kind of task <ref:2611.14048#pg2>. They also surpassed previous state-of-the-art methods across ten different RLBench tasks, getting scores like forty percent on one and seventy percent on another <ref:2611.14048#pg2>.
Dev: I’m looking at the real-world experiments they ran. They showed robust long horizon execution and precise dexterous manipulation in actual physical tasks, which is what I always look for when we move models out of the lab.
Taro: And what about generalization? If you train it on one set of objects and then throw it into a completely different environment with new objects or backgrounds, does it still work well?
Rosa: The paper claims zero-shot generalization to unseen objects, backgrounds, and object positions. That’s a big deal because it means the model isn't just memorizing scenes; it's learning underlying physical interaction principles.
Dev: And they showed particular robustness to spatial perturbations, specifically position shift. They got a forty percent average success rate there, which more than doubles the performance of baselines like pi zero point five and cosmos policy on that specific test <ref:2611.14048#pg2>.
Taro: That doubling is significant when you look at the comparisons they made on those other tasks; for example, it was only fifteen percent for pi zero point five and seventeen percent for cosmos policy.
Rosa: And the authors also did some ablation studies that showed how important the world expert is. When you remove it, their success rate drops from ninety-nine point six percent down to ninety-six point zero percent, which confirms that having those temporal and physical dynamics priors from the world expert is really critical for performance on this LaST0 point 5 framework <ref:2611.14048#pg2>.
Title and authors: Dev: It sounds like the whole point of LaST0 point 5 is to make interaction-centric physical reasoning a scalable way to get good results without having to perfectly model every single physics detail explicitly in the action generation step <ref:2611.14048#pg1>.
Taro: So, if I’m just listening, what does this mean for someone who doesn't work on robotics day-to-day? It means we might start seeing robots that can handle more complex, messy physical tasks without needing perfect pre-programming for every single object they might encounter.
Rosa: That’s the implication. They’re establishing a new state of the art by showing that you can bridge the gap between broad scene understanding and the precise control needed for complex physical execution using this interaction-centric framework called LaST0 point 5 <ref:2611.14048#pg1>.
Dev: So, to wrap up on this paper, we see a model that learns to focus its attention precisely where the action matters, using future cues to guide its planning and adjusting its execution dynamically based on predicted progress.
Taro: I just want to emphasize that while it's impressive with those numbers like ninety-nine point five percent on LIBERO, we have to keep an eye on how it handles truly novel contact dynamics or situations where the interaction cues are missing entirely <ref:2611.14048#pg2>.
Rosa: That’s fair, Taro. The paper itself flags that its success under complex contact dynamics is robust in their real-world deployments, but like any model, it has limits when the visual input doesn't perfectly capture a subtle physical interaction.
Dev: And that limitation ties back to how well the interaction cues are encoded; if those cues aren't visually present or clear enough for the model to see, its precision might drop off significantly.
Taro: So, we’ve got a model that scales by focusing on interactions, adapts its timing based on progress prediction, and shows good zero-shot generalization across different environments. That’s what LaST0 point 5 is doing there <ref:2611.14048#pg1>.
Rosa: Yeah, LaST0 point 5 presents a highly scalable and reliable way to build foundation models for robotics that focus on interaction-centric physical reasoning instead of just global scene dynamics <ref:2611.14048#pg1>.
Dev: It definitely establishes a new standard for how we can combine world modeling with action generation to tackle those hard manipulation problems in the real world.
The paper's summary: Rosa: So, LaST0 point five is basically this new model that tries to fix the problem where world models are too broad and miss the tiny details of how a robot actually moves things.
Dev: Right, it’s introducing an interaction-centric physical representation between modeling what the world looks like and figuring out what actions to take. The authors are calling it ICLR, or Interaction-Centric Latent Reasoning.
Rosa: They argue that global scene representations often ignore the local interactions between the robot and the objects it's touching, which creates a mismatch for actual manipulation.
Dev: And they address this by learning a compact latent space under supervision from visual interaction cues—things like how much motion is happening and what an object affords you to grab. They use a Mixture of Transformers architecture for this latent expert.
Rosa: It’s like they’re training the model to focus its thinking not just on the whole room, but specifically on the areas where manipulation is actually happening.
Dev: They achieve this by building these interaction targets from each frame, using a frozen vision tower to get patches and then summarizing them into a single representation. This is guided by three different loss functions that balance world modeling, latent space learning, and action generation.
Rosa: The way they build the training signal is really interesting because it’s hierarchical. It starts with the world expert predicting what the future scene will look like, and that prediction conditions the latent expert to focus on those interaction points.
Dev: And then there’s this thing called Adaptive World-to-Action Transfer, or AWAT. This mechanism lets the model dynamically adjust how long it plans its actions by looking at predicted progress values from those future frames.
Rosa: So, if the model sees that the world is going in a certain direction, it can truncate its execution based on what it expects next, and then trigger a resampling if things look like they need to change course.
Dev: That sounds like a way to manage the execution horizon without needing a separate planning step for every single action, which is crucial for real-time loops.
Rosa: And in terms of results, LaST0 point five hit ninety-nine point five percent success on the LIBERO benchmark and beat previous state of the art methods on ten different RLBench tasks.
Dev: It’s also been tested in the real world, showing robust long horizon execution and precise dexterous manipulation. That zero-shot generalization to new objects and backgrounds is also pretty impressive.
Rosa: And they showed it handles spatial shifts really well, getting a forty percent success rate on those tests, which more than doubles the performance of some of the older baselines we've seen.
Dev: The authors also did an ablation study where they removed the world expert, and their success rate dropped from ninety-nine point six percent down to ninety-six point zero percent, proving that having those temporal and physical dynamics priors is really important.
Rosa: So, LaST0 point five gives us a way to build generalist models for robotics that focus on interaction-centric physical reasoning instead of just global scene dynamics.
Dev: It establishes a new standard by bridging the gap between broad scene understanding and the precise control needed for complex physical execution in real-world scenarios.
The paper's improvements: Rosa: So we’re looking at some of the specific upgrades they suggest for LaST0 point five now. It’s not just about building it, but making sure it actually performs better in tricky situations.
Dev: Right, they focus on three main areas: generalization, execution robustness, and manipulation precision. First up is improving generalization across unconstrained environments by learning those interaction-centric physical abstractions that connect the global world views to action generation.
Rosa: That means it can handle things it hasn't seen before—like completely different objects or backgrounds—because it’s learning the underlying physics of interaction, not just memorizing scenes.
Dev: Next, they enhance execution robustness by using this Adaptive World-to-Action Transfer mechanism to dynamically adjust the action horizon based on predicted task progress. This is supposed to reduce error accumulation when the world modeling accuracy fluctuates.
Rosa: It means if the model starts getting shaky with its prediction, it can just stop or adjust its plan gracefully instead of failing mid-task.
Dev: And they also focus on making manipulation more precise in real-world scenarios by explicitly supervising the latent reasoning using visual interaction cues during the training process. They augment future frames with a two dimensional curve showing the end effector motion and a bounding box for where the target object is located.
Rosa: So, instead of just guessing where to grab something, it learns exactly where to focus its attention based on what it sees happening in real time.
Dev: That means when the latent expert is conditioning on this augmented input, it learns to focus its attention highly concentrated on the end effector and the specific target objects being manipulated without needing extra architectural changes.
Rosa: And they also show that this interaction-centric reasoning helps filter out irrelevant background information during action generation. The attention maps show that when the latent expert models global dynamics, the attention gets spread out, but with interaction-centric reasoning, it stays highly concentrated on what matters for the task.
Dev: That points to a cleaner control signal being generated because it’s ignoring noise that isn't related to the actual physical contact or target affordance.
Rosa: Overall, these improvements show how they can distill global scene dynamics into compact physical abstractions specifically tailored for manipulation, leading to better performance in high-precision tasks.
Dev: The real implication is that this framework establishes a more reliable way for foundation models to handle the complex physical execution needed in the real world.
Rosa: And it sets up a solid foundation for building models that can actually perform dexterous tasks reliably outside of perfect simulation.
Conclusion: Rosa: So to wrap up, LaST0 point five is this new World Action Model that tries to fix the problem where world models are too broad and miss the tiny details of how a robot actually moves things.
Dev: It’s introducing an interaction-centric physical representation between modeling what the world looks like and figuring out what actions to take. The authors are calling it ICLR, or Interaction-Centric Latent Reasoning.
Taro: It sounds like they’re focusing on making the robot's understanding of physics more grounded in actual contact rather than just looking at pixels.
Rosa: Exactly, they argue that global scene representations often ignore the local interactions between the robot and the objects it's touching, which creates a mismatch for actual manipulation.
Dev: And they address this by learning a compact latent space under supervision from visual interaction cues—things like how much motion is happening and what an object affords you to grab. They use a Mixture of Transformers architecture for this latent expert.
Taro: So the model is essentially learning to prioritize the stuff that matters for physical contact, rather than just memorizing where things are in the scene.
Rosa: It’s like they’re training it to focus its thinking not just on the whole room, but specifically on the areas where manipulation is actually happening.
Dev: They achieve this by building these interaction targets from each frame, using a frozen vision tower to get patches and then summarizing them into a single representation. This is guided by three different loss functions that balance world modeling, latent space learning, and action generation.
Taro: The way they build the training signal is really interesting because it’s hierarchical; it starts with the world expert predicting what the future scene will look like, and that prediction conditions the latent expert to focus on those interaction points.
Rosa: And then there’s this thing called Adaptive World-to-Action Transfer, or AWAT. This mechanism lets the model dynamically adjust how long it plans its actions by looking at predicted progress values from those future frames.
Dev: So, if the model sees that the world is going in a certain direction, it can truncate its execution based on what it expects next, and then trigger a resampling if things look like they need to change course.
Taro: That sounds like a way to manage the execution horizon without needing a separate planning step for every single action, which is crucial for real-time loops.
Rosa: And in terms of results, LaST0 point five hit ninety-nine point five percent success on the LIBERO benchmark and beat previous state of art methods on ten different RLBench tasks.
Dev: It’s also been tested in the real world, showing robust long horizon execution and precise dexterous manipulation. That zero-shot generalization to new objects and backgrounds is also pretty impressive.
Taro: And they showed it handles spatial shifts really well, getting a forty percent success rate on those tests, which more than doubles the performance of some of the older baselines we've seen.
Rosa: The authors also did an ablation study where they removed the world expert, and their success rate dropped from ninety-nine point six percent down to ninety-six point zero percent, proving that having those temporal and physical dynamics priors is really important.
Dev: So, LaST0 point five gives us a way to build generalist models for robotics that focus on interaction-centric physical reasoning instead of just global scene dynamics.
Taro: It’s establishing a new standard by bridging the gap between broad scene understanding and the precise control needed for complex physical execution in real-world scenarios.
Rosa: Yeah, LaST0 point five presents a highly scalable and reliable way to build foundation models for robotics that focus on interaction-centric physical reasoning instead of just global scene dynamics.
Dev: It definitely establishes a new standard for how we can combine world modeling with action generation to tackle those hard manipulation problems in the real world.
Taro: I think the real question is how much more complex of contact dynamics this model can handle before we need even more specialized control methods.
Xuheng Zhang, *, Yiming Zhang, *, Jialin Gao, *, Hao Chen, *†, Jiaming Liu, *†††† Ji Li*, Runzhong Huang , Yinxi Wang , Chenyang Gu , Zihan Yang , Yaowei Liu , Zhonghao Yan , Yaowei Liu1, Zhonghao Yan1, Ziyu Guo2, Renrui Zhang2, Peng Jia3, Pheng-Ann Heng2, Shanghang Zhang1,§ 1State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University 2The Chinese University of Hong Kong 3Simplexity Robotics *Equal contribution †Project leads §Corresponding author
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University · The Chinese University of Hong Kong · Simplexity Robotics
cs.RO
Submitted: 2026-11-10
Updated: 2026-11-10
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Importance score: 100/100
The gist: World Action Models (WAMs) have recently emerged as a promising paradigm for robotic manipulation, endowing policies with strong capabilities for modeling temporal and physical dynamics The paper…
Key concepts
- World Action Models (WAMs)
- These are AI models designed to predict future world states and generate appropriate actions for robots. LaST0.5 is a specific type of WAM that focuses on incorporating physical interactions directly into its reasoning process, moving beyond just predicting what the scene will look like.
- Interaction-Centric Latent Space
- This is a specialized internal representation learned by the model that prioritizes information about the robot's physical contact and manipulation of objects. Instead of focusing only on the whole scene, this space captures how specific parts of the robot interact with specific objects, making it ideal for precise tasks.
- Adaptive World-to-Action Transfer (AWAT)
- This mechanism dynamically adjusts how far into the future the model plans its actions based on predicted progress. It uses 'progress consistency' to decide when to stop executing a plan or when to re-plan, ensuring that the robot adapts its execution horizon smoothly rather than sticking rigidly to a potentially outdated long-term prediction.
Terminology
Summary
World Action Models (WAMs) have recently emerged as a promising paradigm for robotic manipulation, endowing policies with strong capabilities for modeling temporal and physical dynamics The paper proposes LaST0. p. 05, a novel WAM that introduces an interaction-centric physical representation between world modeling and action generation This approach bridges the gap where global scene representations may underemphasize local robot–object interactions, creating a mismatch between representations optimized for world evolution and those required for manipulation. p. 0
Pruning redundant reasoning tokens
LaST0.5 learns a compact interaction-centric latent space under the supervision of visual interaction cues between the robot and the environment This reasoning space is instantiated as a latent expert that bridges the world expert and the action expert within a Mixture-of-Transformers architecture. p. 0 Furthermore, LaST0. p. 05 performs adaptive world-to-action transfer by jointly predicting future representations and progress values, using progress consistency to adjust action execution and trigger future resampling. p. 0
How the training signal is built
The framework follows a hierarchical reasoning paradigm that progressively transforms global world representations into interaction-centric abstractions and ultimately into robot actions. The latent expert is conditioned on future scene representations predicted by the world expert, which are augmented with interaction visual cues encoding manipulation motion and target-object affordance. p. 0 To obtain the interaction-related latent targets, each prompted frame is encoded by a frozen SigLIP vision tower into Np patch tokens of dimension dv, which are then aggregated into a single 1 × dv representation. p. 3 The joint training objective is defined as L = λ1Lworld + λ2Llat + λ3Lact, where coefficients λ1, λ2, and λ3 used to balance the numerical scales of the losses. p. 4
Where the gains come from
LaST0.5 achieves 99. p. 05% on LIBERO and surpasses the previous state of the art on ten evaluated RLBench tasks. p. 0 In real-world experiments, LaST0. p. 05 demonstrates robust long-horizon execution and precise dexterous manipulation in real-world tasks. p. 0 The Adaptive World-to-Action Transfer (AWAT) mechanism dynamically truncates execution based on predicted value sequences, adapting the execution horizon to the predicted progress sequence using progress consistency. p. 3 Ablation studies confirm that removing the world expert drops the success rate from 99. p. 56% to 96.0%, highlighting its importance in providing temporal and physical dynamics priors. p. 5
Real-world performance and generalization
LaST0.5 achieves an average success rate of 99. p. 15% on the LIBERO benchmark and an 88. p. 10% success rate on RLBench, outperforming the previous state-of-the-art (SOTA) methods. p. 1 In real-world deployments, LaST0. p. 15 demonstrates robust long-horizon execution and precise control on challenging manipulation tasks. p. 1 The model exhibits zero-shot generalization to unseen objects, backgrounds, and object positions. p. 1 It shows particular robustness to spatial perturbations (Position shift), achieving a 40. p. 60% average success rate that more than doubles the performance of strong baselines like π0. p. 65 (15.0%) and Cosmos Policy (17. p. 15%). The framework establishes a new state-of-the-art on both benchmarks. p. 5
Conclusion
LaST0.5 presents a highly scalable and reliable paradigm for interaction-centric robotic foundation models. p. 7 The authors conclude that LaST0. p. 05 bridges the critical gap between global scene dynamics and localized robotic manipulation. p. 7 The model is pretrained on over 14k hours of heterogeneous robot data, establishing interaction-centric physical reasoning as a scalable and effective paradigm. p. 0 The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 p. 5 The findings confirm the real-world robustness of LaST0. p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 65 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 p. 6 The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 p. 0 The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task success over the base model without AWAT. The findings confirm the real-world robustness of LaST0.5 under complex contact dynamics, effectively bridging broad scene understanding with the precise, closed-loop control required for complex physical execution. The paper establishes interaction-centric physical reasoning as a scalable and effective paradigm. The work demonstrates that progress-guided adaptive execution improves task su… p. 5
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Improved generalization across unconstrained environments by learning interaction-centric physical abstractions that bridge global world representations with action generation. This allows LaST0.5 to demonstrate
zero-shot generalization to unseen objects, backgrounds, and object positions.
-
Enhanced execution robustness by dynamically adapting the action horizon based on predicted task progress using the Adaptive World-to-Action Transfer mechanism. This reduces error accumulation when world modeling accuracy fluctuates, as it
dynamically truncates execution based on the predicted value sequence
andtriggers future resampling when needed.
-
More precise manipulation in real-world scenarios through explicit supervision from visual interaction cues during latent reasoning. By augmenting future frames with
a 2D curve representing the corresponding end-effector motion and a bounding box grounding the target-object affordance,
the system learns to focus oninteraction-relevant regions without requiring architectural modifications.
-
Superior performance in high-precision tasks by distilling global scene dynamics into compact physical abstractions tailored for manipulation. The latent expert learns
compact physical representations centered on robot environment interactions
and is conditioned on this space to generate precise robot actions, as the paper states,conditioning on this latent space, the efficient action expert generates precise robot actions.
-
Robust performance under visual perturbations by learning to ignore irrelevant background information during action generation. The attention maps show that when the latent expert models global scene dynamics,
the attention becomes noticeably dispersed,
whereas interaction-centric reasoning ensureshighly concentrated attention on the endeffector and the specific target objects being manipulated.
Sources
- Cosmos 3: Omnimodal World Models for Physical AI
- World Simulation with Video Foundation Models for Physical AI
- Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulation
- AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems
- InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation
- Fast-in-Slow: A Dual-System Foundation Model Unifying Fast Manipulation within Slow Reasoning
- HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models
- ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulation
- EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Video
- Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representations
- RLBench: The Robot Learning Benchmark & Learning Environment
- DreamGen: Unlocking Generalization in Robot Learning through Video World Models
- DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
- Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning
- OpenVLA: An Open-Source Vision-Language-Action Model
- Causal World Modeling for Robot Control
- World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems
- CrayonRobo: Object-Centric Prompt-Driven Vision-Language-Action Model for Robotic Manipulation
- Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
Related papers
- Rethinking Actions: Continuity-Aware Priors for World-Model Planning
- MOSAIC: Modular Obstacle and Spatial-Aware Framework for Manipulation In Cluttered Scenes
- SAGAS: Semantic-Aware Graph-Assisted Stitching for Offline Temporal Logic Planning
- DexSeed: Expanding Human Hand-Object Interactions into Robot Demonstrations for Dexterous Policy Learning
- CIALLO: Learning Shared Intent Representations for Cross-Embodiment Manipulation
- SSR: Scaling Surefooted and Symmetric Humanoid Traversal Toward the Open World