Can LLM Agents Be Forward-Deployed Engineers? Requirement Discovery and Delivery for Enterprise Text-to-SQL
cs.CL, cs.AI
Submitted: 2026-11-02
Updated: 2026-11-02
Code: https://github.com/meta-llama/llama-models
Terminology
Sources
- Agent squared RL-Bench: Can LLM Agents Engineer Agentic RL Post-Training?
- Command A: An Enterprise-Ready Large Language Model
- Trains but Doesn't Learn: A Post-Training Delivery Benchmark for LLM Agents as Forward-Deployed Engineers
- FDE-Bench: Evaluating LLM Agents for Deployment Environment Configuration
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation
- Dialogue SWE-Bench: A Benchmark for Dialogue-Driven Coding Agents
- FT-Dojo: Towards Autonomous LLM Fine-Tuning with Language Agents
- gpt-oss-120b & gpt-oss-20b Model Card
- PostTrainBench: Can LLM Agents Automate LLM Post-Training?
- SOMA-SQL: Resolving Multi-Source Ambiguity in NL-to-SQL via Synthetic Log and Execution Probing
- DeployBench: Benchmarking LLM Agents for Research Artifact Deployment
- RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data