SafeLLM4SE: Statistical Evaluation and Reporting for LLM-based Software Engineering Systems
cs.SE, cs.LG
Submitted: 2026-09-29
Updated: 2026-09-29
Code: https://github.com/francisco-ortin/safellm4se
Sources
- Deep Reinforcement Learning at the Edge of the Statistical Precipice
- Evaluating Large Language Models Trained on Code
- How Many Random Seeds? Statistical Power Analysis in Deep Reinforcement Learning Experiments
- Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation
Related papers
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- SABER: Benchmarking Operational Safety of LLM Coding Agents in Stateful Project Workspaces
- PackMonitor: Enabling Zero Package Hallucinations Through Decoding-Time Monitoring
- IntentCoding: Amplifying User Intent in Code Generation
- Incentives and Outcomes in Bug Bounties