Who Can Evaluate AI Independently? A Framework for Analysing Evaluation Infrastructure
cs.CY, cs.AI
Submitted: 2026-11-05
Updated: 2026-11-05
Terminology
Sources
- IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models
- How much speech data is necessary for ASR in African languages? An evaluation of data scaling in Kinyarwanda and Kikuyu
- Towards Publicly Accountable Frontier LLMs: Building an External Scrutiny Ecosystem under the ASPIRE Framework
- Uhura: A Benchmark for Evaluating Scientific Question Answering and Truthfulness in Low-Resource African Languages
- Multilingual Jailbreak Challenges in Large Language Models
- Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned
- A Safe Harbor for AI Evaluation and Red Teaming
- Rethinking Evidence Hierarchies in Medical Language Benchmarks: A Critical Evaluation of HealthBench
- AfroBench: How Good are Large Language Models on African Languages?
- The Multilingual Divide and Its Impact on Global AI Safety
- AI and the Everything in the Whole Wide World Benchmark
- Who Evaluates AI's Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations
- Computing Power and the Governance of Artificial Intelligence
- Improving Methodologies for Agentic Evaluations Across Domains: Leakage of Sensitive Information, Fraud and Cybersecurity Threats
- Structured access: an emerging paradigm for safe AI deployment
- Model evaluation for extreme risks
- Double Jeopardy and Climate Impact in the Use of Large Language Models: Socio-economic Disparities and Reduced Utility for Non-English Speakers
- InkubaLM: A small language model for low-resource African languages
- Improving Methodologies for LLM Evaluations Across Global Languages
Related papers
- AI-Mediated Communication Can Steer Collective Opinion
- Epistemic Infrastructures of Science in AI Era Should Rebalance Costs of Generation and Verification
- AI out-persuades expert humans in text-based dialogue
- Evaluating Ambient Clinical Scribes in India: The Need for Multilingual Real-World Clinical Conversation Data
- AI Value Alignment for Evolving Social Norms
- Voting Biases in Decentralized Autonomous Organization (DAO) Governance