The Testability Gap: A Pre-Registered Census of Naming versus Implementation in 59 Cognitive-Architecture LLM Systems
cs.SE
Submitted: 2026-10-31
Updated: 2026-10-31
Terminology
Sources
- The Rise and Potential of Large Language Model Based Agents: A Survey
- MemGPT: Towards LLMs as Operating Systems
- Are We Measuring Scientific Intelligence? Rethinking the Evaluation of AI Scientists
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- Kernel Autoresearch for Open-Ended Model Discovery
- Evaluating Large Language Models Trained on Code
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters