Spec-Driven PBT: Deriving Semantic Invariants from Code Specifications for Agentic Property-based Testing
cs.SE, cs.AI
Submitted: 2026-11-11
Updated: 2026-11-17
Terminology
Sources
- Understanding the (In)Security of Vibe-Coded Applications
- What's Wrong with Your Code Generated by Large Language Models? An Extensive Study
- Specification Grounding Drives Test Effectiveness for LLM Code
- Effective LLM Code Refinement via Property-Oriented and Structurally Minimal Feedback
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- PBT-Bench: Benchmarking AI Agents on Property-Based Testing
- ProjDevBench: Benchmarking AI Coding Agents on End-to-End Project Development
- Agentic Property-Based Testing: Finding Bugs Across the Python Ecosystem
- The End of Code Review: Coding Agents Supersede Human Inspection
- BaxBench: Can LLMs Generate Correct and Secure Backends?
- Can Large Language Models Write Good Property-Based Tests?
- From Natural Language to Executable Properties for Property-based Testing of Mobile Apps
- Is Vibe Coding Safe? Benchmarking Vulnerability of Agent-Generated Code in Real-World Tasks
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters