Key Institutional Considerations for Designing Effective Independent Verification Organizations
cs.AI
Submitted: 2026-11-06
Updated: 2026-11-10
Terminology
Sources
- Paradigms of AI Evaluation: Mapping Goals, Methodologies and Culture
- A Survey on Evaluation of Large Language Models
- Unsafe at any AUC: Unlearned Lessons from Sociotechnical Disasters for Responsible AI
- Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance
- Who Evaluates AI's Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations
- Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects
- Real-World AI Evaluation: How FRAME Generates Systematic Evidence to Resolve the Decision-Maker's Dilemma
- The Role of Governments in Increasing Interconnected Post-Deployment Monitoring of AI
- Sociotechnical Safety Evaluation of Generative AI Systems
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents