EAGER: Enhancing Generative Event Extraction via Reinforcement Learning with Verifiable Rewards
cs.CL
Submitted: 2026-09-24
Updated: 2026-09-24
Comments: Accepted to EMNLP 2026 Findings
Code: https://github.com/huggingface/trl
License: http://creativecommons.org/licenses/by/4.0/
The gist: End-to-end event extraction remains challenging for large language models as it requires simultaneous identification of event triggers, classification of event types, and extraction of
Terminology
Abstract
End-to-end event extraction remains challenging for large language models as it requires simultaneous identification of event triggers, classification of event types, and extraction of schema-grounded argument spans. We present EAGER, a reinforcement learning framework for generative event extraction that combines fine-grained verifiable rewards with Schema-Contrastive Advantage Estimation to alleviate advantage collapse under sparse binary rewards. Our reward design explicitly targets structural validity, extraction accuracy, groundedness, coverage, over-generation, and span precision. Experiments across seven benchmark datasets show that EAGER consistently outperforms prompting, supervised fine-tuning, and prior reinforcement learning baselines, achieving a substantial improvement over the strongest prior method. Results demonstrate that task-aligned verifiable rewards and contrastive advantage estimation substantially improve structured extraction.
Sources
- SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
- EventRL: Enhancing Event Extraction with Outcome Supervision for Large Language Models
- Exploring the Feasibility of ChatGPT for Event Extraction
- The Llama 3 Herd of Models
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning
- GPT-4o System Card
- GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimization
- OpenAI o1 System Card
- PIVOINE: Instruction Tuning for Open-world Information Extraction
- Cross-media Structured Common Space for Multimedia Event Extraction
- Code Llama: Open Foundation Models for Code
- Proximal Policy Optimization Algorithms
- OpenAI GPT-5 System Card
- InstructUIE: Multi-task Instruction Tuning for Unified Information Extraction
- Scaf-GRPO: Scaffolded Group Relative Policy Optimization for Enhancing LLM Reasoning
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering