Structured Prompts Improve Evaluation of Language Models
cs.CL, cs.AI, cs.LG
Submitted: 2025-11-25
Updated: 2026-11-03
Terminology
Sources
- MedVAL: Toward Expert-Level Medical Text Validation with Language Models
- MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notes
- GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
- HalluLens: LLM Hallucination Benchmark
- MedHELM: Holistic Evaluation of Large Language Models for Medical Tasks
- Training Verifiers to Solve Math Word Problems
- Measuring Massive Multitask Language Understanding
- DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
- A Survey of Automatic Prompt Engineering: An Optimization Perspective
- Holistic Evaluation of Language Models
- Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
- From Medprompt to o1: Exploration of Run-Time Strategies for Medical Challenge Problems and Beyond
- Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs
- Dynamic Rewarding with Prompt Optimization Enables Tuning-free Self-Alignment of Language Models
- To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning
- HEAD-QA: A Healthcare Dataset for Complex Reasoning
- PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data