A Shared Taste for Model-Written Text: The Generator-by-Selector Matrices of "AI-AI Bias" Show No Detectable Own-Model Premium

arXiv:2610.00369 · cs.IR, cs.AI, cs.CL · Submitted 2026-09-30 · Read on arXiv

cs.IR, cs.AI, cs.CL

Submitted: 2026-09-30

Updated: 2026-09-30

Comments: 10 pages, 4 figures, 3 tables. Reanalysis of publicly available generator-by-selector matrices

Code: https://github.com/lauritowal/ai-ai-bias

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• LLM-as-a-Judge — 3× in this paper · explained in 3 episodes
• LLM judge — 2× in this paper · explained in 2 episodes
• RAG — 2× in this paper · explained in 3 episodes
• Alignment — 1× in this paper · explained in 1 episode
• Benchmarking — 1× in this paper · explained in 3 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Perplexity — 1× in this paper · explained in 3 episodes

Sources

• AI-AI Bias: large language models favor communications generated by large language models
• LLM Evaluators Recognize and Favor Their Own Generations
• Self-Preference Bias in LLM-as-a-Judge
• Self-Recognition in Language Models
• Know Thyself? On the Incapability and Implications of AI Self-Recognition
• Do LLM Evaluators Prefer Themselves for a Reason?
• Are LLM Evaluators Really Narcissists? Sanity Checking Self-Preference Evaluations
• Self- and Other-Labels Induce Bidirectional Bias in LLM Judges
• Quantifying and Mitigating Self-Preference Bias of LLM Judges
• Self-Preference Is Weak or Absent in Verifiable Instruction-Following Revision: A Four-Model Test Under Genuine Authorship
• Play Favorites: A Statistical Method to Measure Self-Bias in LLM-as-a-Judge
• AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
• Who Judges Matters: Measuring Family-Conditioned Preference in LLM-as-Judge Panels
• Evaluating Large Language Model Raters for German Open-Response Clinical Questions: A Physician-Annotated Benchmark Study of Agreement, Evaluator Bias, and Abstention
• Preference Leakage: A Contamination Problem in LLM-as-a-judge
• Self-Preference Bias in Rubric-Based Evaluation of Large Language Models
• On the impact of retrieved content representations in RAG Pipelines
• What Generative Search Engines Like and How to Optimize Web Content Cooperatively

Related papers

• The Price of Isolation: Estimating the Ecosystem Cost of Symmetric Two-Sided A/B Testing
• SCAR: Semantic Continuity-Aware Retrieval for Efficient Context Expansion in RAG
• MixLoRA-DSI: Dynamically Expandable Mixture-of-LoRA Experts for Rehearsal-Free Generative Retrieval over Dynamic Corpora
• How Do LLM-Generated Texts Impact Term-Based Retrieval Models?
• MemSyco-Bench: Benchmarking Sycophancy in Agent Memory
• Training with Missed Targets in Generative Recommendation: Separating Supervision from Probability Competition