Discovering Sensorimotor Agency in Cellular Automata using Diversity Search
cs.MA, cs.AI, cs.LG
Submitted: 2024-02-14
Updated: 2024-02-14
Journal ref: Sci. Adv. 11 (44), eadp0834, (2025)
Code: https://github.com/flowersteam/sensorimotor-lenia-search
Project page: https://developmentalsystems.org/sensorimotor-lenia-companion
License: http://creativecommons.org/licenses/by/4.0/
The gist: The research field of Artificial Life studies how life-like phenomena such as autopoiesis, agency, or self-regulation can self-organize in computer simulations.
Terminology
Abstract
The research field of Artificial Life studies how life-like phenomena such as autopoiesis, agency, or self-regulation can self-organize in computer simulations. In cellular automata (CA), a key open-question has been whether it it is possible to find environment rules that self-organize robust "individuals" from an initial state with no prior existence of things like "bodies", "brain", "perception" or "action". In this paper, we leverage recent advances in machine learning, combining algorithms for diversity search, curriculum learning and gradient descent, to automate the search of such "individuals", i.e. localized structures that move around with the ability to react in a coherent manner to external obstacles and maintain their integrity, hence primitive forms of sensorimotor agency. We show that this approach enables to find systematically environmental conditions in CA leading to self-organization of such basic forms of agency. Through multiple experiments, we show that the discovered agents have surprisingly robust capabilities to move, maintain their body integrity and navigate among various obstacles. They also show strong generalization abilities, with robustness to changes of scale, random updates or perturbations from the environment not seen during training. We discuss how this approach opens new perspectives in AI and synthetic bioengineering.
Sources
- Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutions
- Solving Rubik's Cube with a Robot Hand
- Emergent Tool Use From Multi-Agent Autocurricula
- Open-Ended Learning Leads to Generally Capable Agents
- Emergent Complexity via Multi-Agent Competition
- WebGPT: Browser-assisted question-answering with human feedback
- Toolformer: Language Models Can Teach Themselves to Use Tools
Related papers
- Highway Congestion Reduction through Reinforcement Learning Based Eulerian Headway Control
- Temporal Fair Division in Multi-Agent Systems: From Precise Alternation Metrics to Scalable Coordination Proxies
- Auditable and Deployable Multi-Agent Motion Planning via Posetal Games from Legal Guidelines
- ORACLE-SWE: Quantifying the Contribution of Critical Information Signals on SWE Agents
- You Only Align Once: Propagating Cooperative Behaviors in Multi-Agent Systems through Seed Agents
- Deny Without Disabling: Authorization-Paired Evaluation and Control for Multi-Agent Systems