Density Matrices for Metaphor Understanding
cs.CL
Submitted: 2024-08-12
Updated: 2024-08-12
Comments: In Proceedings QPL 2024, arXiv:2408.05113
Journal ref: EPTCS 406, 2024, pp. 197-215
DOI: 10.4204/EPTCS.406.9
License: http://creativecommons.org/licenses/by/4.0/
The gist: In physics, density matrices are used to represent mixed states, i.e.
Terminology
Abstract
In physics, density matrices are used to represent mixed states, i.e. probabilistic mixtures of pure states. This concept has previously been used to model lexical ambiguity. In this paper, we consider metaphor as a type of lexical ambiguity, and examine whether metaphorical meaning can be effectively modelled using mixtures of word senses. We find that modelling metaphor is significantly more difficult than other kinds of lexical ambiguity, but that our best-performing density matrix method outperforms simple baselines as well as some neural language models.
Sources
- The Mathematics of Text Structure
- Meaning updating of density matrices
- Mathematical Foundations for a Compositional Distributional Model of Meaning
- Density Matrices with Metric for Derivational Ambiguity
- Cats climb entails mammals move: preserving hyponymy in compositional distributional semantics
- Distributed Representations of Words and Phrases and their Compositionality
- Conversational Negation using Worldly Context in Compositional Distributional Semantics
- Attention Is All You Need
- Ordering information on distributions
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering