Revisiting LLM Homogeneity Through a Multidimensional Lens
cs.CL, cs.AI
Submitted: 2026-11-01
Updated: 2026-11-01
Code: https://github.com/ziliang6/HomogeneityEvaluation
Terminology
Sources
- jina-embeddings-v5-text: Task-Targeted Embedding Distillation
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- Gemma 4 Technical Report
- Gemma 3 Technical Report
- Gemma 2: Improving Open Language Models at a Practical Size
- The Llama 3 Herd of Models
- Task-Dependent Evaluation of LLM Output Homogenization: A Taxonomy-Guided Framework
- Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)
- Where does output diversity collapse in post-training?
- Tulu 3: Pushing Frontiers in Open Language Model Post-Training
- Towards General Text Embeddings with Multi-stage Contrastive Learning
- Olmo Hybrid: From Theory to Practice and Back
- Qwen2.5 Technical Report
- How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Models
- How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapse
- Evaluating the Diversity and Quality of LLM Generated Content
- Olmo 3
- 2 OLMo 2 Furious
- We're Different, We're the Same: Creative Homogeneity Across LLMs
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data