Towards the Automatic Synthesis of Interpretable Chess Tactics
cs.AI, cs.LG, cs.SC
Submitted: 2026-10-06
Updated: 2026-10-06
Journal ref: Proceedings of the Explainable Agency in Artificial Intelligence Workshop, 36th AAAI Conference on Artificial Intelligence, 91-97, Mar 2022
License: http://creativecommons.org/licenses/by/4.0/
The gist: State-of-the-art reinforcement learning agents are capable of outperforming human experts at games like chess, Go and StarCraft II.
Abstract
State-of-the-art reinforcement learning agents are capable of outperforming human experts at games like chess, Go and StarCraft II. These agents do not simply take advantage of their digital hardware in being able to react and calculate faster than humans, but employ better strategies that lead to more victories. Interpreting these strategies would give human players valuable insight into how to improve their play. In this preliminary work, we propose a symbolic sub-policy model for playing chess. Inspired by chess tactics, our model attempts to incorporate domain knowledge to improve interpretability. We adapt patterns learned by an inductive logic programming system called PAL to derive our model. We contribute a divergence metric to evaluate our model against a random baseline, and find a set of tactics that is able to suggest moves of similar playing strength to a human beginner. Finally, we propose a computational evaluation scheme for the model by augmenting an off-the-shelf engine with it.
Sources
- Verifiable Reinforcement Learning via Policy Extraction
- Dota 2 with Large Scale Deep Reinforcement Learning
- Inductive logic programming at 30: a new introduction
- Suphx: Mastering Mahjong with Deep Reinforcement Learning
- Acquisition of Chess Knowledge in AlphaZero
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems