Testing Conversation Preservation Across LLM APIs: A Rule-Based Oracle for Detecting Silent Information Loss
cs.SE, cs.AI
Submitted: 2026-11-11
Updated: 2026-11-11
Code: https://github.com/agentgateway/agentgateway
Terminology
Sources
- How is ChatGPT's behavior changing over time?
- Holistic Evaluation of Language Models
- The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters