LDC: Learning to Generate Research Idea with Dynamic Control

arXiv:2412.14626 · cs.CL, cs.AI · Submitted 2024-12-19 · Read on arXiv

cs.CL, cs.AI

Submitted: 2024-12-19

Updated: 2026-09-02

Journal ref: EMNLP 2026

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Fine-Tuning — 26× in this paper · explained in 5 episodes
• Reinforcement Learning — 18× in this paper · explained in 4 episodes
• Transformer — 16× in this paper · explained in 2 episodes
• Benchmark — 11× in this paper · explained in 2 episodes
• Transformer Models — 11× in this paper · explained in 2 episodes
• Accuracy — 9× in this paper · explained in 1 episode
• Supervised Fine-Tuning — 9× in this paper
• Steering — 4× in this paper · explained in 2 episodes
• Annotator Agreement — 3× in this paper
• Many Heads Are Better Than One — 3× in this paper
• Reinforcement Learning (RL) — 3× in this paper · explained in 25 episodes
• Supervised Fine-Tuning (SFT) — 3× in this paper · explained in 8 episodes
• Ablation — 2× in this paper · explained in 1 episode
• Alignment — 2× in this paper
• Multi-agent Collaboration — 2× in this paper · explained in 2 episodes
• Reward Function — 2× in this paper · explained in 4 episodes
• Actor — 1× in this paper · explained in 3 episodes
• Adaptability — 1× in this paper · explained in 1 episode
• Agent Interactions — 1× in this paper
• Consistency — 1× in this paper · explained in 3 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Generalizability — 1× in this paper · explained in 6 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Interpretability — 1× in this paper · explained in 15 episodes
• Knowledge Graph — 1× in this paper · explained in 7 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 8 episodes
• Multi-Agent System — 1× in this paper · explained in 7 episodes
• Proximal Policy Optimization — 1× in this paper
• Proximal Policy Optimization (PPO) — 1× in this paper · explained in 7 episodes
• Resource Constraints — 1× in this paper · explained in 4 episodes
• Robustness — 1× in this paper · explained in 5 episodes

Sources

• Exploring Optimal DNN Architecture for End-to-End Beamformers Based on Time-frequency References
• MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agents
• The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
• WebGPT: Browser-assisted question-answering with human feedback
• Unlock the Correlation between Supervised Fine-Tuning and Reinforcement Learning in Training Code Large Language Models
• Training language models to follow instructions with human feedback
• Improving alignment of dialogue agents via targeted human judgements
• A Survey of Deep Learning for Scientific Discovery
• Proximal Policy Optimization Algorithms
• SciCode: A Research Coding Benchmark Curated by Scientists
• In-context Learning and Induction Heads
• Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey
• Fine-Tuning Language Models from Human Preferences

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering