Grounding Video Reasoning in Physical Signals
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: We're looking at the paper: "Grounding Video Reasoning in Physical Signals".
Title and authors: Tom: So we’re looking at this paper now. It’s called "Grounding Video Reasoning in Physical Signals". It sounds intense but basically they are trying to figure out if video models can actually understand the physics behind what they see, not just name an event correctly.
Jane: That makes sense. Because right now, a model might tell you that something is happening in a video—like pouring water—but it might totally mess up where or when that pouring actually happens in the scene. This paper is building a benchmark to test if the AI actually has that physical understanding baked in.
Lu: They take the structure from V-STaR and they expand it way out. Instead of just one type of question, they’re testing across six different physics domains, like gravity or friction, and three different ways to ask the question—physics based, a comparison style called vstar like, and a neutral control.
Meng: Six domains? That sounds like a lot of complexity to manage when you're trying to get reliable data. What’s the actual scale here? Are we talking about thousands of videos or something manageable for production testing?
Lalam: They use one thousand five hundred sixty base video clips from four different sources including SSV2 and YouCook2 and HoloAssist and Roundabout-TAU <ref:2604.21873#pg1,1,560 base video clips from>. Each clip gets converted into one shared grounded event record, which then feeds into all three query families.
Tom: That shared event record is the key thing they’re doing there, because it means that across all those different ways of asking the question, like physics versus vstar like, they are all scoring against the exact same ground truth for what happened and when it happened.
Jane: It’s clever because even though the wording changes—you might ask about a collision or a fluid flow—the underlying physical event is fixed, so you can really see if the model is getting confused by the language or if it's actually grasping the physics.
Lu: The paper highlights that across all these models and prompt families, physics reasoning still ends up being the strongest performance regime overall. But they also point out that neutral rstr behaves like a harder control, which means it’s a tougher test for those models to pass.
Title and authors: Meng: So if I'm looking at this for deployment, does that mean I should prioritize training on physics data because that’s where the performance is strongest? Or are there other ways to get usable results?
Tom: Not necessarily prioritizing one domain, Meng. The paper notes that prompt family robustness isn't uniform across models; some models are strong in one way but weak in another, so you have to check each model against each formulation individually.
Jane: And they also found that spatial grounding—getting the right 'where'—is consistently the weakest part across all these settings, even when a model performs well on other things. They say no model managed to get above a mean spatial IoU of zero point seventy-three.
Lu: That low spatial grounding is significant because it shows that just getting the event label right doesn't guarantee you’ve localized it correctly in space. It suggests that even for strong models, time and space are still tricky anchors.
Meng: So, if I’m deploying a system, what does this tell me about what breaks at scale? Does the temporal ordering or the fine appearance details matter more than the coarse structure they mentioned?
Tom: They set up an input perturbation framework where they test four conditions: original, shuffled, ablated, and frame-masked. Shuffling messes up the time order while keeping all the frames, ablation removes color and detail but keeps structure, and frame masking removes evidence intermittently while keeping the time structure.
Jane: That’s a great way to see what a model depends on—is it dependent on knowing what came before, or is it just looking for persistent visual evidence regardless of when it appears?
Lu: The diagnostic metrics they use are Acc for the what, tIoU for the when, and sIoU for the where, which they then combine with the Logarithmic Geometric Mean to give a single score that tells you if all three parts are strong.
Meng: What about these derived indices like SBI and PRI? They sound like ways to quantify exactly how much performance drops when you introduce temporal shuffling or ablation. Is that something an engineer can actually use for debugging a deployed model?
Tom: Exactly. SBI measures the sensitivity of the temporal ordering, and PRI tells you how much performance is retained when you remove color and fine details. These indices let you see if a model’s failure is because it lost its temporal awareness or because it just got noisy input.
Title and authors: Jane: It’s about moving beyond just looking at a final accuracy number and actually seeing *why* the score shifted when you change one tiny visual thing. That helps us understand the model's reasoning process more deeply.
Lu: The paper suggests that for real-world use, we need to look at these diagnostics alongside aggregate scores because the aggregate score can hide a lot of this behavior. They even found that prompt family shifts are model specific, not universal across all AI systems.
Meng: That’s a bit concerning if we expect models to perform consistently across different interfaces or user queries. If one formulation works great and another fails, it adds operational overhead for us.
Tom: It means we can’t just pick the highest aggregate score; we have to understand which prompt family that model is actually tuned for, based on these diagnostics. Physics framing seems to be a strong indicator of what the model is inherently good at handling.
Jane: So, if we take this whole study—this paper "Grounding Video Reasoning in Physical Signals"—what does it change for someone who just listens to the show? It means we need to stop judging video models by simple accuracy and start demanding they prove they have temporal and spatial grounding when answering physical questions.
Lu: Because the paper shows that strong semantic accuracy doesn't automatically translate into strong temporal or spatial grounding, which is a critical distinction.
Meng: For deployment, that means we need to test our models not just on whether they get the answer right, but on how they handle noise and changes in input quality. If a model fails spectacularly when you slightly blur the video, that’s a red flag for production use.
Tom: Basically, this work gives us a toolkit—the benchmark and these diagnostics—to stop treating video Q andA just as text retrieval problems and start treating it like physics reasoning.
Jane: And they’ve set up this whole system so we can see exactly where the model gets lost in time or space, which is really illuminating for understanding what we still don't know about how these models truly "see."
The paper's summary: Tom: So, this paper is about taking video understanding beyond just naming things and making sure the AI actually understands the physical world behind what it sees.
Jane: Exactly. They built this benchmark that takes a structure from V-STaR and expands it way out to test six different physics domains like gravity or friction, plus three ways to ask the question—physics based, a comparison style, and a neutral control.
Tom: And they use four ways to mess with the video input—shuffled time order, ablated colors and fine details, or frame masking—to see what makes the model actually rely on versus just guessing.
Jane: The big takeaway is that while physics reasoning is the strongest part of this test, it doesn't mean a model automatically gets good at grounding things in space or time.
Tom: That’s because they found that spatial grounding, getting the right 'where,' stays the weakest point across all these settings, even when a model leads in other areas.
Jane: And they show that you can actually measure how much performance drops when you introduce temporal shuffling or remove visual details using these specific diagnostic indices.
Tom: Those indices, like SBI and PRI, let us see if the model is failing because it lost its sense of time or just because the input got noisy.
Jane: It really changes things for someone who only listens to this—it means we need to stop judging video models by simple accuracy numbers and start demanding they prove they have temporal and spatial grounding when answering physical questions.
Tom: And the authors themselves flag that automatic supervision in this process adds noise, so we can't just take those numbers at face value without looking at these diagnostics first.
Jane: That’s right. It’s about moving beyond just getting the answer right and actually understanding *how* the AI is reasoning about time and space within a physical scene.
The paper's improvements: Tom: So, moving on from just describing the benchmark, the authors aren't just stopping there; they’re suggesting how to actually improve these models for real use cases.
Jane: They are focusing on three main things: first, they want to see if we can make the prompt families more useful by showing how different ways of asking questions perform against each other.
Tom: They are also proposing a way to diagnose the model’s weaknesses by using these specific indices—SBI for temporal shuffling sensitivity, PRI for ablation retention ratio, and SPI for frame masking retention ratio.
Jane: Those indices let us see if a model is failing because it lost its sense of time or just because the input got noisy, which is super useful information.
Tom: And they’re looking at how these prompt-family shifts happen—they found that those changes are model specific, not universal across different AI systems.
Jane: So what does this mean for us? It means we can't just pick the highest aggregate score; we have to check which prompt family that model is actually tuned for based on these diagnostics.
Tom: They suggest training models specifically to show selective robustness across those prompt types, so you know exactly which query style works best for a given physical event.
Jane: It also points out that spatial grounding is the weakest component still, with no model reaching a mean spatial IoU of zero point seventy three, which is pretty low.
Tom: That tells us that even if a model gets the event label right, it often fails to localize it correctly in space during testing.
Jane: The authors also have some limitations they mention—for instance, they are not looking at things like causal forecasting or long-horizon planning; they aren't testing those kinds of reasoning yet.
Tom: And they’re using automatic supervision for the event descriptions, which introduces noise because those descriptions are made automatically rather than being fully verified by human annotators.
Jane: So what this means for the world is that we need to be more careful about what we expect from video AI; it’s still just a tool that needs this kind of rigorous physical grounding validation before you trust its spatial and temporal answers in critical applications.
Conclusion: Tom: So to wrap this up, we’re looking at "Grounding Video Reasoning in Physical Signals," which is a major benchmark designed to test if video AI actually understands physics, not just event naming.
Jane: Basically, they built this whole structure to see if models can nail the what, when, and where of an event across six different physics domains and three ways of asking the question.
Tom: They also set up these input perturbations—shuffled time order, ablated details—to figure out whether a model depends on temporal order or just persistent visual evidence.
Jane: The results show that while physics reasoning is the strongest overall, spatial grounding remains a clear weakness for almost every model tested.
Tom: That’s a big number, because they found no model managed to get above zero point seventy three mean spatial IoU across all those settings.
Jane: So what this means for us is that just getting the event label right doesn't guarantee the AI has localized it in space or time, even when it performs well on other things.
Tom: And they’re suggesting that prompt family robustness isn't a universal thing; different models show strong performance in different query styles, which helps engineers pick the right formulation for their needs.
Jane: It also highlights that we need to look at these detailed diagnostics like SBI and PRI alongside the final accuracy score to truly understand *why* a model is succeeding or failing.
Tom: Lalam agrees that this benchmark gives us a solid direction, confirming that physics framing is the strongest regime, but it also warns us about where the current limitations are in spatial localization.
Jane: So yeah, "Grounding Video Reasoning in Physical Signals" gives us a much clearer picture of what video AI still needs to learn about reality before we can use it for high-stakes tasks.
Tom: It’s a solid paper, but remember, the authors themselves flagged some noise because the event descriptions are automatically generated and not fully verified by humans.
Jane: Exactly, so we need to keep that caveat in mind—it’s a tool for diagnostics, not a perfect truth generator yet.
Lu: From my side, I think the ambition here is great because it pushes models to reason about causality and planning in a physical context, which is where the next generation of representation learning needs to go.
Meng: For me, what matters is that we can identify exactly what breaks at scale; if we can use these perturbation tests to find weaknesses before deployment, that saves us a lot of money on fixing broken systems later.
Lalam: I’m confident in this direction; the paper’s methodology for deriving those three query families from a shared event record is very clean, and my internal checks show strong consistency with what they report.
Queen Mary University of London
cs.CV
Submitted: 2026-04-23
Updated: 2026-11-17
Comments: 10 pages, 2 figures, 7 tables. Accepted at the 2nd Workshop on Video Large Language Models (VidLLMs), CVPR 2026. v2: final workshop version, adding a manual audit of about 120 records and a case-level analysis of perturbation effects
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Importance score: 83/100
The gist: Physical video understanding requires more than naming an event correctly<ref:2604.21873#pg2> A grounded benchmark for physical video understanding extends the what–when–where evaluation…
Key concepts
- Grounded Event Record
- Every video clip is first converted into a single shared record detailing exactly what happened, when it happened (temporal span), and where it happened (spatial reference). This fixed record serves as the common ground for all subsequent evaluations, ensuring that different questions about the same event are scored against the exact same physical reality.
- Prompt Families
- The evaluation uses three distinct query styles: physics family, vstar like, and neutral rstr. These families are derived from the grounded event record but use different phrasing for 'what' and 'where'. This design allows researchers to see how robust a model is when asked questions in different linguistic contexts.
- Input Perturbations
- Base video clips are tested under four conditions: Original, Shuffled (temporal order removed), Ablated (color/detail removed), and Frame-Masked (evidence intermittently removed). These tests diagnose whether a model relies on the exact temporal sequence, fine visual details, or persistent structural evidence to answer correctly.
- Diagnostic Indices
- Metrics like SBI, PRI, and SPI are calculated by comparing performance scores under different input conditions (e.g., original vs. shuffled). These indices provide specific diagnostics that measure a model's sensitivity to temporal order or visual detail degradation rather than just reporting an aggregate accuracy score.
Terminology
Summary
Physical video understanding requires more than naming an event correctly<ref:2604. p. 021873#pg2> A grounded benchmark for physical video understanding extends the what–when–where evaluation structure of V-STaR [5] to four video sources, six physics domains, three prompt families (physics, vstar like, and neutral rstr), and four input conditions (original, shuffled, ablated, and frame-masked<ref:2604. p. 0 p. 021873#pg3> The benchmark contains 1,560 base video clips from SSV2 [11], YouCook2 [32], HoloAssist [24], and Roundabout-TAU [16]<ref:2604. p. 0 p. 021873#pg4> Each clip is first converted into a shared grounded event record, and the three query families are derived from that record<ref:2604. p. 0 p. 021873#pg5> Across models and prompt families, physics remains the strongest regime overall, vstar like is the clearest non-physics semantic comparison, and neutral rstr behaves as a harder templated control<ref:2604. p. 0 p. 021873#pg6> Prompt-family robustness is selective rather than universal, perturbation gains cluster in weak original cases, and spatial grounding is the weakest across settings<ref:2604. p. 0 p. 021873#pg7> These results suggest that video Q&A reasoning benchmarks shall report physically grounded, prompt-aware, and perturbationaware diagnostics alongside aggregate accuracy<ref:2604. p. 0 p. 021873#pg8>
Benchmark Structure and Prompt Design
The benchmark inherits the grounded what–when–where evaluation structure introduced by V-STaR [5]<ref:2604.21873#pg9> Given a video clip and a physical question, the model must produce a single structured prediction with three fields: a what, a when, and a where<ref:2604. p. 2 p. 221873#pg10> The prompt families are not separate annotation pipelines All three are derived from the same grounded event record, which fixes the event identity, temporal span, and spatial reference For cross-family evaluation, a when and a where are therefore scored against the same targets in every family The text field works slightly differently The physics family uses the reference event description directly, while neutral rstr and vstar like use shorter familyappropriate semantic a what targets derived from that same record
Input Perturbation Framework
Each base clip is evaluated under four input conditions: Original, Shuffled, Ablated, and Frame-Masked Each condition targets a different component of the visual signal The shuffled condition removes temporal order while preserving the frame set The ablated condition removes color and fine appearance detail while preserving coarse structure Frame masking removes evidence intermittently while preserving the temporal structure Together, these conditions let us ask whether a model depends on temporal order, appearance detail, or persistent visual evidence
Diagnostic Metrics and Indices
The three output fields are scored with grounded metrics: Acc for a what, tIoU for a when, and sIoU for a where These components are combined with the Logarithmic Geometric Mean (LGM) LGM is high only when all three components are strong Three diagnostic indices are derived from the four condition scores: SBI = 1 − (LGMorig − LGMshuf), PRI = LGMabl / LGMorig, and SPI = LGMmask / LGMorig These indices are interpreted together with component deltas, baseline strata, validity transitions, and qualitative examples
Key Findings on Performance
The main physics benchmark shows that strong semantic accuracy does not guarantee equally strong temporal or spatial grounding Qwen3-VL leads Acc, Qwen2.5-VL leads tIoU and sIoU, and VideoLLaMA3 leads LGM Spatial grounding remains the clearest weakness, with no model exceeding 0. p. 6073 mean sIoU Cross-family shifts are model-specific rather than uniform High performance under physics-framed queries therefore does not necessarily transfer to alternative semantic formulations
Domain and Model Specific Behavior
Domain leaders vary by domain, with Qwen3-VL leading Gravity and Friction, VideoLLaMA3 leading Fluids, and Qwen2.5-VL leading Collisions, Deformation, and State Changes The underlying limitation does not change: spatial grounding remains weak even when a model leads a domain Model physics vstar like neutral rstr Table 7 shows that Qwen3-VL / physics ablated +0. p. 6589 highbaseline gain, Molmo2 / physics shuffled +0. p. 7326 midbaseline temporal gain, and Gemma4 / neutral rstr shuffled +0. p. 7347 controlfamily gain
Limitations of the Study
Automatic supervision introduces noise because event descriptions, temporal spans, and spatial boxes are produced automatically rather than fully verified by human annotators Annotation-style bias exists because text annotations are generated with an LLM-based stage that is closely related to one model family Source imbalance exists because Roundabout-TAU contributes only 85 clips, compared with 600 each from SSV2 and YouCook2 The study evaluates grounded event understanding, not causal forecasting or long-horizon planning Diagnostic interpretation is used, not causal explanation of how each model reasons internally
Conclusion
The experiments support three conclusions: physics is strongest overall, vstar like is the strongest non-physics comparison, neutral rstr is better read as a harder control, and prompt-family robustness is selective rather than universal Spatial grounding remains the weakest component, so answer accuracy alone still hides too much behavior A model can still recover the event label while failing to ground it in time or space, and prompt-family changes and input perturbations make that failure easier to see The benchmark is designed so that a score shift can be traced back to model behavior without arbitrary drift in the underlying grounded event
--- Page 9 ---
References
[1] Piyush Bagad, Makarand Tapaswi, and Cees G. M. Snoek. Test of time: Instilling video-language models with a sense of time [2] Shuai Bai, Yuxuan Cai, Ruizhe Chen, Keqin Chen, Xionghui Chen, Zesen Cheng, Lianghao Deng, Wei Ding, Chang Gao, Chunjiang Ge, et al. p. 8 Qwen3-VL technical report [3] Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, Humen Zhong [4] Shyamal Buch et al. p. 8 Revisiting the “video” in video-language understanding [5] Zixu Cheng, Jian Hu, Ziquan Liu, Chenyang Si, Wei Li, and Shaogang Gong. p. 8 V-star: Benchmarking video-llms on video spatio-temporal reasoning [6] Wei Chow et al. p. 8 PhysBench: Benchmarking and enhancing vision-language models for physical world understanding [7] Christopher Clark et al. p. 8 Molmo2: Open weights and data for vision-language models with video understanding and grounding [8] Chaoyou Fu et al. p. 8 Video-MME: The first-ever comprehensive evaluation benchmark of multi-modal LLMs in video analysis [9] Jiyang Gao et al. p. 8 TALL: Temporal activity localization via language query [10] Google DeepMind. p. 8 gemma-4-26b-a4b-it [11] Raghav Goyal et al. p. 8 The “something something” video database for learning and evaluating visual common sense [12] Ranjay Krishna et al. p. 8 Dense-captioning events in videos [13] Jie Lei et al. p. 8 TVQA+: Spatio-temporal grounding for video question answering [14] Kunchang Li et al. p. 8 MVBench: A comprehensive multimodal video understanding benchmark [15] Bin Lin et al. p. 8 Video-LLaVA: Learning united visual representation by alignment before projection [16] Yuqiang Lin et al. p. 8 TAU-R1: Visual language model for traffic anomaly understanding [17] Shilong Liu et al. p. 8 Grounding DINO: Marrying DINO with grounded pre-training for open-set object detection [18] Muhammad Maaz et al. p. 8 Video-ChatGPT: Towards detailed video understanding via large vision and language models [19] Qwen Team. p. 8 Qwen3.5-9b-base [20] Marco Tulio Ribeiro et al. p. 8 Beyond accuracy: Behavioral testing of NLP models with CheckList [21] Ronan Riochet et al. p. 8 IntPhys: A framework and benchmark for visual intuitive physics reasoning [22] Tristan Thrush et al. p. 8 Winoground: Probing vision and language models for visiolinguistic compositionality
(Note: The token IDs above are placeholders based on the provided text structure and must be replaced with the actual IDs from the paper's reference list if available, but since only one arXiv ID is given, I will use a placeholder format consistent with your instructions.)
(Self-Correction: Since only one arXiv ID is provided (2604.21873), all tokens will use this prefix for the ID and page number N. p. 0)
Final Output based on strict token rules:
Physical video understanding requires more than naming an event correctly<ref:2604.21873#pg2> A grounded benchmark for physical video understanding extends the what–when–where evaluation structure of V-STaR [5] to four video sources, six physics domains, three prompt families (physics, vstar like, and neutral rstr), and four input conditions (original, shuffled, ablated, and frame-masked<ref:2604.21873#pg3> The benchmark contains 1,560 base video clips from SSV2 [11], YouCook2 [32], HoloAssist [24], and Roundabout-TAU [16]<ref:2604.21873#pg4> Each clip is first converted into a shared grounded event record, and the three query families are derived from that record<ref:2604.21873#pg5> Across models and prompt families, physics remains the strongest regime overall, vstar like is the clearest non-physics semantic comparison, and neutral rstr behaves as a harder templated control<ref:2604.21873#pg6> Prompt-family robustness is selective rather than universal, perturbation gains cluster in weak original cases, and spatial grounding is the weakest across settings<ref:2604.21873#pg7> These results suggest that video Q&A reasoning benchmarks shall report physically grounded, prompt-aware, and perturbationaware diagnostics alongside aggregate accuracy<ref:2604.21873#pg8>
Benchmark Design and Evaluation
The benchmark inherits the grounded what–when–where evaluation structure introduced by V-STaR [5]<ref:2604.21873#pg9> Given a video clip and a physical question, the model must produce a single structured prediction with three fields: a what, a when, and a where<ref:2604.21873#pg10> The prompt families are not separate annotation pipelines All three are derived from the same grounded event record, which fixes the event identity, temporal span, and spatial reference For cross-family evaluation, a when and a where are therefore scored against the same targets in every family The text field works slightly differently The physics family uses the reference event description directly, while neutral rstr and vstar like use shorter familyappropriate semantic a what targets derived from that same record
Perturbation Analysis Framework
Each base clip is evaluated under four input conditions: Original, Shuffled, Ablated, and Frame-Masked Each condition targets a different component of the visual signal The shuffled condition removes temporal order while preserving the frame set The ablated condition removes color and fine appearance detail while preserving coarse structure Frame masking removes evidence intermittently while preserving the temporal structure Together, these conditions let us ask whether a model depends on temporal order, appearance detail, or persistent visual evidence
Diagnostic Interpretation and Results
The three output fields are scored with grounded metrics: Acc for a what, tIoU for a when, and sIoU for a where These components are combined with the Logarithmic Geometric Mean (LGM) LGM is high only when all three components are strong The main physics benchmark shows that strong semantic accuracy does not guarantee equally strong temporal or spatial grounding Spatial grounding remains the clearest weakness, with no model exceeding 0.
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Grounding video reasoning in physical signals by introducing a benchmark that extends V-STaR to six physics domains (Gravity, Fluids, Collisions, Deformation, Friction, and State Changes). This allows for diagnostics on whether a model is grounded in time or space when answering questions about specific physical events.
-
Developing a three-prompt evaluation design (physics family, vstar like family, and neutral rstr) derived from the same shared grounded event record. This separates the main physics regime from semantic comparisons and neutral wording controls to isolate how different query formulations affect performance.
-
Implementing a perturbation analysis framework using shuffled, ablated (greyscale and blurred), and frame-masked inputs alongside component-wise metrics like text accuracy, temporal IoU, spatial IoU, and LGM. This allows for diagnostics on whether a model depends on temporal order, appearance detail, or persistent visual evidence rather than just an original input score.
-
Utilizing diagnostic indices such as SBI (temporal shuffling sensitivity), PRI (ablation retention ratio), and SPI (frame-masking retention ratio). These indices provide descriptive diagnostics that interpret changes under degraded evidence by comparing perturbed condition scores to the original condition score.
-
Training models specifically to show selective prompt-family robustness across different prompt types, demonstrating that
prompt-family robustness is selective rather than universal.
This informs model selection based on which query style yields the best performance for a given physical event.
Sources
- Qwen3-VL Technical Report
- Qwen2.5-VL Technical Report
- V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoning
- PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding
- Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding
- Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
- TAU-R1: Visual Language Model for Traffic Anomaly Understanding
- Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection
- InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency
- InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modeling
- MiniCPM-V: A GPT-4V Level MLLM on Your Phone
- VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs