DistDebug-Bench: Can LLM Agents Diagnose Bugs in Distributed Systems?
cs.SE, cs.DC, cs.LG
Submitted: 2026-11-02
Updated: 2026-11-07
Code: https://github.com/OrderLab/distdebug-bench
Terminology
Sources
- Program Synthesis with Large Language Models
- Evaluating Large Language Models Trained on Code
- AIOpsLab: A Holistic Framework to Evaluate AI Agents for Enabling Autonomous Clouds
- SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
- The PetShop Dataset -- Finding Causes of Performance Issues across Microservices
- RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems
- Training Software Engineering Agents and Verifiers with SWE-Gym
- RCAEval: A Benchmark for Root Cause Analysis of Microservice Systems with Telemetry Data
- DebugBench: Evaluating Debugging Capability of Large Language Models
- SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
- SWE-bench Goes Live!
- LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters