What does it mean to understand language?

summary

The gist

Language understanding entails not just extracting the surface-level meaning of the linguistic input, but constructing rich mental models of the situation it describes The paper proposes that because…

In short

Deep language understanding requires exporting information from the brain's limited core language system to other cognitive regions that build mental models of the world. The core system handles surface-level linguistic patterns, but deep meaning needs integration with perceptual, motor, and memory systems to create rich situational awareness.

Key concepts

Core Language System
This is the brain network highly specialized for processing language itself. It extracts information from word sequences based on language statistics but lacks sensitivity to real-world plausibility or context outside of linguistic patterns.
Exportation
The process where information generated by the core language system is transferred out to other brain regions. This transfer enriches the initial linguistic representation with perceptual features, motor data, or knowledge from other systems.
Shallow Understanding
This is the basic level of language comprehension where a system only recognizes words and how they fit together in a sentence structure. It relies solely on patterns learned from language use and ignores real-world context.
Deep Understanding
This involves constructing rich mental models of people, objects, and situations described in language. It is achieved when the core system exports information to systems that build models of minds, places, and physical realities.

Terminology used across episodes

This episode discusses

The paper

What does it mean to understand language? · Read on arXiv

Kempner Institute for the Study of Natural & Artificial Intelligence at Harvard University · School of Psychology at Georgia Institute of Technology · Department of Brain and Cognitive Sciences at Massachusetts Institute of Technology

Language understanding entails not just extracting the surface-level meaning of the linguistic input, but constructing rich mental models of the situation it describes. Here we propose that because processing within the brain's core language system is fundamentally limited, deeply understanding language requires exporting information from the language system to other brain regions that construct mental models of minds, objects, and places, and that compute perceptual and motor representations. Building on earlier theorizing and empirical work, we argue that recent progress in cognitive neuroscience provides both the conceptual foundation and the methods to directly evaluate this hypothesis, thus opening up a new strategy to reveal what it means, cognitively and neurally, to understand language.

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "What does it mean to understand language?".

Jane: Here's the gist of the paper. Language understanding entails not just extracting the surface-level meaning of the linguistic input, but constructing rich mental models of the situation it describes The paper proposes that because processing within the brain’s core language system is fundamentally limited, deeply understanding language requires exporting information from the language system to other brain regions that compute perceptual and motor representations, construct mental models, and store our world knowledge and autobiographical memories This framework suggests that deep understanding necessitates exporting information from the core language system to other cognitive and neural systems The Core Language System's Role in Understanding The core language system is specifically engaged in understanding (and producing) language, and not in other nonlinguistic cognitive processes fMRI research over the last 15 years has identified and characterized the brain’s core language system with new precision During comprehension, the language system’s goal is to extract information from word sequences, which requires recognizing familiar words and larger constructions and figuring out how they go together within the sentence However, we argue that this representation is shallow: it is derived solely from our knowledge of language statistics, akin to representations in early versions of text-only large language models Furthermore, the representations in the language system lack sensitivity to real-world plausibility Mechanisms for Deep Understanding Deep understanding is supported by extra-linguistic systems that can be engaged both by linguistic and nonlinguistic inputs These extra-linguistic systems can augment the shallow representations constructed by the core language system with perceptual or motor features, translate them into a format compatible with probabilistic programing engines or symbolic problem solvers, or transform them in some other way The paper identifies several candidate exportation destinations including regions specialized for thinking about the contents of someone else’s or one’s own mind, regions specialized for scene understanding and navigation, regions that construct mental models of the physical world, regions that represent and process amodal semantic information, perceptual and motor regions, and regions that integrate information into a coherent representation of the situation that is being described Specific Exportation Destinations The paper details several brain regions that support deep language understanding, such as those involved in theory of mind, intuitive physics, navigation and scene understanding For instance, theory of mind involves the right temporo-parietal junction (rTPJ) and the broader Theory of Mind network Intuitive physics involves regions of the parietal and frontal cortex in the "Physics Network" Navigation and scene understanding involve areas like the parahippocampal place area (PPA), occipital place area (OPA), and retrosplenial cortex (RSC) Perceptual regions can be engaged when understanding verbal descriptions of visual scenes, such as faces or bodies Motor representations are also implicated when understanding action words, linking to motor cortex regions Episodic and semantic knowledge is accessed through the Default Network A (DN-A) for episodic memory and amodal semantic regions for general conceptual knowledge Factors Influencing Exportation The likelihood of information exportation depends on several factors, including the language system's memory limitations, traits, states, and goals of the comprehender Specifically, input that extends beyond a sentence must be passed to other systems to construct temporally extended contexts Furthermore, the language system must be able to extract a representation abstract enough to interface with downstream systems The process of exportation can occur through two main possibilities: "routing," where information is selectively directed, or "broadcasting," where representations are sent to all possible downstream systems The paper concludes that deep language understanding requires exporting information from the brain’s core language system to other systems that build mental models of the minds, objects, and places described in the linguistic input Caveats include the fact that strong empirical evidence for exportation is restricted to a few systems and methodological limitations restrict conclusions from past work Future research should focus on how language representations are "translated" into a format other brain regions can process and what specific factors influence whether and when information is exported Outstanding questions remain regarding the extent to which everyday language understanding takes place within the core language system The paper proposes a broad research program to advance a richer theory of what language understanding entails cognitively, neurally, and computationally Glossary Exportation: The process by which information delivered through language is transferred out of our core language system to one or more other brain regions for further processing Shallow understanding: Building a representation of linguistic input based solely on knowledge of patterns of language use Deep understanding: Building rich mental models of the people, objects, places, and situations described in a language input Situation model: A representation of the ‘situation’ that is being described by a language input Core language system: A network of frontal and temporal brain regions that are highly specialized for language processing, strongly functionally and anatomically interconnected, and causality important in comprehending and producing language Routing: One hypothesis for how information is exported from the language system to downstream systems, whereby information is selectively directed Broadcasting: Another hypothesis for how information is exported to downstream systems, whereby information is sent from the core language system to all possible downstream systems Acknowledgments We thank Andrea de Varda, Ted Gibson, Steve Piantadosi, Rebecca Saxe, Thomas Clark, and members of the Kanwisher lab for helpful discussion and comments on the manuscript We also thank Emalie McMahon for help with the brain maps for the figure CC was supported by the Kempner Institute for the Study of Natural and Artificial Intelligence at Harvard University EF was partially supported by U01 award NS121471 from NINDS, funds from the Simons Foundation awarded to the Simons Center for the Social Brain at MIT, from the McGovern Institute for Brain Research, and MIT’s Quest Initiative NK was partially supported by funds from the Simons Foundation awarded to the Simons Center for the Social Brain at MIT, from the McGovern Institute for Brain Research, and MIT’s Quest Initiative References Zhang, Y., Kauf, C., Levy, R.

Tom: P., Gibson, E.

Jane: (2025).

Tom: Comparative illusions are evidence of rational inference in language comprehension.

Paper summary: Tom: So, to summarize "What does it mean to understand language?", the main thesis is that deep understanding requires exporting information from our core language system to other brain regions that compute perceptual and motor representations, construct mental models of the situation described, and store world knowledge and autobiographical memories.

Jane: They review the existing evidence for this hypothesis and argue that progress in cognitive neuroscience suggests this export mechanism is necessary.

Lu: The paper sets up a framework where the core language system is engaged in processing linguistic forms, but these representations are shallow because they are derived only from knowledge of language statistics, sort of like early versions of text-only large language models.

Meng: So what's the problem with that? If it’s just statistics, how can we get anything meaningful out of it?

Tom: The paper points out that these core representations lack sensitivity to real-world plausibility. They aren't really connected to actual experience.

Jane: And they suggest that deep understanding is supported by extra-linguistic systems that can augment those shallow representations with perceptual or motor features, or translate them into formats like probabilistic programming engines.

Lu: They identify several candidate exportation destinations, including regions specialized for thinking about someone's mind, scene understanding and navigation areas, regions that build mental models of the physical world, and amodal semantic information processing.

Conclusion: Tom: So, looking at "What does it mean to understand language?", the main implication is that if we want a real grasp of what someone is saying, we can't rely only on the core language system doing all the heavy lifting.

Jane: It means deep understanding isn't just about parsing grammar or finding word patterns; it’s about connecting those words to things happening in the real world, like knowing how an object moves or what a person is thinking.

Lu: The paper suggests that exporting information allows for building those rich mental models of people, objects, and places described in the language input.

Meng: So if we think about this from a practical standpoint, it means AI systems that want to be truly competent at understanding language need more than just massive text data; they need those connections to other sensory or physical representations.

Tom: Exactly. The authors suggest future research should focus on how language representations get translated into a format that other brain regions can actually process and what specific factors cause that information to be exported when it is.

Jane: It sets up a broad research program, suggesting we need to look at this from cognitive, neural, and computational angles to advance our theory of language understanding.

Lu: They also flag a limitation in their work: the strong empirical evidence for this exportation is currently restricted to only a few specific systems.

More episodes

← Home