SWE-Mutation: Can LLMs Generate Reliable Test Suites in Software Engineering?
cs.SE, cs.AI
Submitted: 2026-05-21
Updated: 2026-05-21
Code: https://github.com/Sunny4Coding/SWE-Mutation
Terminology
Sources
- Program Synthesis with Large Language Models
- Evaluating Large Language Models Trained on Code
- Kimi K2: Open Agentic Intelligence
- gpt-oss-120b & gpt-oss-20b Model Card
- Qwen3 Technical Report
- SWE-smith: Scaling Data for Software Engineering Agents
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters