Internalizing Academic Writing Workflows for Introduction Generation via Struct-Aware Policy Learning
Meicong Zhang, Tiancheng Su, Jiahao Cheng, Guoxiu He, Xinqi Tao, Dejia Song
cs.CL, cs.AI
Submitted: 2026-08-04
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Generating a rigorous paper introduction with large language models (LLMs) remains challenging, since it requires coordinating background, gap identification, method and contribution within a
Terminology
Abstract
Generating a rigorous paper introduction with large language models (LLMs) remains challenging, since it requires coordinating background, gap identification, method and contribution within a coherent narrative. Existing solutions externalize this process as multi-stage prompts or agent workflows which are expensive and vulnerable to cross-stage drift. We propose StructPO, a struct-aware policy learning framework that internalizes the entire multi-stage writing workflow into a single-pass policy controlled by explicit stage tokens. StructPO introduces struct-aware credit assignment to decouple local stage quality from global coherence and refinement-guided optimization to internalize revision behavior into the first-pass policy. Experiments show that StructPO improves semantic alignment, structural rationality and inference efficiency over workflow-based baselines, generalizes to out-of-domain settings, and remains competitive with GPT-5.1 in human evaluation when scaled to Qwen3-32B. These results show that internalizing academic writing workflows through fine-grained policy optimization offers a viable alternative to costly external orchestration.
Sources
- GPT-4 Technical Report
- LitLLM: A Toolkit for Scientific Literature Review
- Self-Guided Process Reward Optimization with Redefined Step-wise Advantage for Process Reinforcement Learning
- Towards AI-Assisted Research Writing: Benchmarking LLMs for AI/ML Introduction Generation
- DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
- SketchVL: Policy Optimization via Fine-Grained Credit Assignment for Chart Understanding and More
- A Vision for Auto Research with LLM Agents
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- Agent Laboratory: Using LLM Agents as Research Assistants
- Proximal Policy Optimization Algorithms
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- MinerU: An Open-Source Solution for Precise Document Content Extraction
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
- SurveyForge: On the Outline Heuristics, Memory-Driven Generation, and Multi-dimensional Evaluation for Automated Survey Writing
- Qwen3 Technical Report
- Qwen2 Technical Report
- Eliminating Agentic Workflow for Introduction Generation with Parametric Stage Tokens
- Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering