Read the Room, Read the Image: Understanding Indirect Speech Acts in Multimodal Visual Contexts

arXiv:2608.30270 · cs.CL · Submitted 2026-08-31 · Read on arXiv

cs.CL

Submitted: 2026-08-31

Updated: 2026-08-31

Comments: Accepted to Findings of ACL 2026

Code: https://github.com/jaeheehui/ISA-data

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Indirect Speech Act — 31× in this paper
Benchmark — 27× in this paper · explained in 2 episodes
Accuracy — 20× in this paper · explained in 1 episode
Pragmatics — 7× in this paper · explained in 2 episodes
Alignment — 6× in this paper · explained in 1 episode
Ablation — 5× in this paper · explained in 1 episode
Adaptation — 5× in this paper · explained in 1 episode
Grounding — 3× in this paper · explained in 3 episodes
Visual Question Answering — 3× in this paper
Ablation study — 2× in this paper · explained in 1 episode
Cross-Cultural Speech Act Realization Project — 2× in this paper
ACT Data — 1× in this paper · explained in 1 episode
Core — 1× in this paper · explained in 2 episodes
F1 Score — 1× in this paper · explained in 3 episodes
Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
Multimodal Integration — 1× in this paper · explained in 2 episodes
Robustness — 1× in this paper · explained in 5 episodes
Visual Grounding — 1× in this paper · explained in 2 episodes

Sources

Related papers