Do Semantic Distance Tests Actually Predict Creativity in LLMs? Evidence for Jagged Creativity
cs.AI, cs.CL, cs.HC
Submitted: 2026-05-13
Updated: 2026-11-07
Code: https://github.com/lechmazur/writing
Terminology
Sources
- Probing the Creativity of Large Language Models: Can models produce divergent semantic association?
- Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
- On the Measure of Intelligence
- Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)
- Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
- Beyond Divergent Creativity: A Human-Based Evaluation of Creativity in Large Language Models
- Progress measures for grokking via mechanistic interpretability
- In-context Learning and Induction Heads
- EQ-Bench: An Emotional Intelligence Benchmark for Large Language Models
- Transformational Creativity in Science: A Graphical Theory
- Open Problems in Mechanistic Interpretability
- Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers
- The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas
- OMEGA: Can LLMs Reason Outside the Box in Math? Evaluating Exploratory, Compositional, and Transformative Generalization
- CREATE: Testing LLMs for Associative Creativity
- SciMON: Scientific Inspiration Machines Optimized for Novelty
- Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?
- NoveltyBench: Evaluating Language Models for Humanlike Diversity
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents