TLAPS-Bench: Formally Proving Correctness of Real-World System Specifications with TLA+ Proof System
cs.AI, cs.DC, cs.LO, cs.SE
Submitted: 2026-11-02
Updated: 2026-11-02
Code: https://github.com/specula-org/TLAPS-Bench
Terminology
Sources
- Inductive Deductive Synthesis: Enabling AI to Generate Formally Verified Systems
- Can LLMs Write Correct TLA+ Specifications? Evaluating Natural-Language-to-TLA+ Generation
- TLA+-Bench: An Execution-Grounded Benchmark and Dataset for Natural-Language to TLA Specification Generation
- Can Large Language Models Model Programs Formally?
- Specula: Scaling formal specifications for autonomous model checking of system code
- DafnyBench: A Benchmark for Formal Software Verification
- TLA-Verus: Generating and Solving Temporal Proof Obligations with LLM Agents
- Rango: Adaptive Retrieval-Augmented Proving for Automated Software Verification
- VeriSoftBench: Repository-Scale Formal Verification Benchmarks for Lean
- VeruSAGE-Bench: A Benchmark Suite for Rust System Verification
- Vero: Can AI Agents Build Formally Verified Software Repositories?
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents