Optimization without Future Compromises? Decentralized Coordination via Collective and Reinforcement Learning

arXiv:2509.18088 · cs.MA, cs.LG · Submitted 2025-09-22 · Read on arXiv

cs.MA, cs.LG

Submitted: 2025-09-22

Updated: 2026-09-23

Comments: This work has been submitted to the IEEE for possible publication

Code: https://github.com/TDI-Lab/HRCL

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Reinforcement Learning — 38× in this paper · explained in 4 episodes
• Combinatorial Optimization — 25× in this paper · explained in 2 episodes
• Actor — 16× in this paper · explained in 3 episodes
• Action Space — 11× in this paper · explained in 1 episode
• Multi-Agent System — 11× in this paper · explained in 6 episodes
• Communication Overhead — 8× in this paper · explained in 2 episodes
• Hierarchical Framework — 6× in this paper · explained in 2 episodes
• Abstraction — 5× in this paper · explained in 1 episode
• Adaptability — 5× in this paper · explained in 1 episode
• Deep Reinforcement Learning — 5× in this paper · explained in 2 episodes
• Reward Function — 4× in this paper · explained in 2 episodes
• Hierarchical Reinforcement and Collective Learning — 3× in this paper
• Loss Function — 3× in this paper · explained in 2 episodes
• Multi-Agent Reinforcement Learning (MARL) — 3× in this paper · explained in 4 episodes
• Objective Function — 3× in this paper · explained in 2 episodes
• Benchmark — 2× in this paper · explained in 2 episodes
• Core — 2× in this paper · explained in 2 episodes
• Proximal Policy Optimization — 2× in this paper
• Task Planning — 2× in this paper · explained in 2 episodes
• Temporal Abstraction — 2× in this paper · explained in 2 episodes
• Ablation — 1× in this paper · explained in 1 episode
• Ablation Studies — 1× in this paper · explained in 1 episode
• Accuracy — 1× in this paper · explained in 1 episode
• Adaptation — 1× in this paper · explained in 1 episode
• Differential Privacy — 1× in this paper · explained in 4 episodes
• Energy Efficiency — 1× in this paper · explained in 3 episodes
• Hierarchical Reinforcement Learning (HRL) — 1× in this paper · explained in 2 episodes
• Proximal Policy Optimization (PPO) — 1× in this paper · explained in 4 episodes
• Pruning — 1× in this paper · explained in 4 episodes
• Sample Efficiency — 1× in this paper · explained in 4 episodes
• Transformer — 1× in this paper · explained in 2 episodes

Related papers

• Highway Congestion Reduction through Reinforcement Learning Based Eulerian Headway Control
• ORACLE-SWE: Quantifying the Contribution of Critical Information Signals on SWE Agents
• You Only Align Once: Propagating Cooperative Behaviors in Multi-Agent Systems through Seed Agents
• Deny Without Disabling: Authorization-Paired Evaluation and Control for Multi-Agent Systems
• MA-SAPO: Multi-Agent Reasoning for Score-Aware Prompt Optimization
• PeroMAS: A Multi-agent System of Perovskite Material Discovery