Do Language Models Know Their Slang? Queer Slang Understanding in User-Generated Content
Arianna Denitto, Beatrice Savoldi
cs.CL
Submitted: 2026-08-05
Code: https://github.com/ariadne28/Slang-Q
Project page: https://kittensyzygy.github.io/polari-dictionary/home.html
License: http://creativecommons.org/licenses/by/4.0/
The gist: Despite its cultural relevance and diffusion, queer slang remains underrepresented in Natural Language Processing research.
Terminology
Abstract
Despite its cultural relevance and diffusion, queer slang remains underrepresented in Natural Language Processing research. Towards addressing this gap, we introduce Slang-Q, a manually curated dataset of naturally user-generated English sentences paired with queer slang terms and reference definitions, built upon a newly constructed taxonomy of 118 queer terms. We use this resource to conduct a first exploratory evaluation of language models on their ability to understand and define queer slang under varying prompting conditions. Slang-Q is intended as a basis for studying how current models handle sensitive, community-specific language and whether they can provide accurate and reliable information about such forms of identity and linguistic expression.
Sources
- Generative AI Practices, Literacy, and Divides: An Empirical Analysis in the Italian Context
- Queer NLP: A Critical Survey on Literature Gaps, Biases and Trends
- SLAyiNG: A Diverse and Community-validated Dataset of Queer Slang
- Unequal Voices: How LLMs Construct Constrained Queer Narratives
- Agree to Disagree? A Meta-Evaluation of LLM Misgendering
- Qwen3 Technical Report
- The Llama 4 Herd: Architecture, Training, Evaluation, and Deployment Notes
- The Llama 3 Herd of Models
- BERTScore: Evaluating Text Generation with BERT
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering