Learning Time-Varying Connectomes for Stable Behavior Across Development

summary

The gist

Neural circuits must maintain functionality to drive effective behavior while their size, topology, geometry…

In short

The study investigated whether a single generative encoding could create recurrent neural networks that maintain behavior across substantial developmental changes in neural structure and dynamics. By optimizing a connectivity generator based on developmental time, researchers found that controllers optimized across multiple developmental snapshots maintained significantly higher and more consistent performance over the entire development interval, demonstrating functional stability without needing structural invariance.

Key concepts

Developmental Substrate
This refers to the biological constraints of neural development, such as when neurons are born (birth), where they are placed (position), how they process sensory input, and their inherent speed or timing (intrinsic time constants). The study used different versions of this substrate to simulate different stages of brain growth.
Time-Varying Connectivity Program
This is a single generative encoding designed to produce the specific connections (connectome) needed for a neural network at any given point in development. Instead of one fixed structure, this program changes its output based on the developmental time input, allowing it to generate age-specific connectivity patterns.
Functional Stability
This is the ability of a neural circuit to continue performing its intended task (like motor control) even when its underlying physical structure—its size, shape, or connections—is continuously changing. The paper shows this can emerge from a time-varying program rather than requiring the physical structure itself to remain static.

Terminology used across episodes

This episode discusses

The paper

Learning Time-Varying Connectomes for Stable Behavior Across Development · Read on arXiv

Christof Fehrman, Jacob J. Morra, Eva A. Naumann

Neurobiology, Duke University

Neural circuits must maintain functionality to drive effective behavior while their size, topology, geometry, and intrinsic dynamics change across development. To model developing visuomotor circuits and behavior, we investigated whether a single compact generative encoding could produce functional recurrent controllers across such changes. Building on the HyperNEAT algorithm, we represented this program as a compositional pattern-producing network that received developmental time as an input to generate age-specific connectivity. The developmental substrate prescribed neuronal birth, position, sensory organization, and intrinsic time constants. We tested this approach using two geometrically distinct developmental substrates and two visuomotor tasks: optomotor responses and phototaxis. Controllers optimized at only the initial or mature substrate generally failed when evaluated at other ages. In contrast, controllers optimized across multiple developmental snapshots maintained substantially higher and more consistent performance across trained and unseen ages. Optimization at only three developmental snapshots was often sufficient to produce effective behavior across the tested developmental interval. The resulting connectomes changed substantially with age and did not converge on a single trajectory of sparsity or connection-weight statistics. Controllers also differed in whether they relied on neurons born later in development. These results demonstrate that a shared spatiotemporal time-varying connectivity program can produce recurrent neural networks that preserve behavior across substantial developmental changes. Together, these results provide a framework for studying how functional stability can emerge without requiring structural or dynamical stability.

Transcript

Introduction to the show: ident: Genomics Radio. Generated commentary on the latest computational biology and genomics papers.

Ines: We're looking at the paper: "Learning Time-Varying Connectomes for Stable Behavior Across Development".

Marcus: Here's the gist of the paper. Neural circuits must maintain functionality to drive effective behavior while their size, topology, geometry, and intrinsic dynamics change across development The results demonstrate that a shared spatiotemporal time-varying connectivity program can produce recurrent neural networks that preserve behavior across substantial developmental changes This provides a framework for studying how functional stability can emerge without requiring structural or dynamical stability Developmental Modeling and Hypothesis The study investigated whether a single compact generative encoding could produce functional recurrent controllers across developmental changes The developmental substrate prescribed neuronal birth, position, sensory organization, and intrinsic time constants The authors hypothesized that developing connectomes possess compressible spatiotemporal structure that can be represented directly as a function of neural geometry and developmental time They tested this using two geometrically distinct developmental substrates and two visuomotor tasks Optimization Strategy The researchers formulated developmental functional stability as a trajectory-level optimization problem They evolved a compact connectivity generator that receives neural geometry and developmental time as inputs to generate the connectivity of a recurrent controller for the substrate at any point of development Optimization was performed across multiple developmental snapshots, and performance was evaluated across the full developmental interval rather than just at maturity Performance Across Development Controllers optimized at a single developmental endpoint generally failed to transfer away from that endpoint In contrast, controllers optimized across development maintained substantially higher and more consistent fitness over the developmental interval This stability was observed across both substrate geometries and both visuomotor tasks Connectome Stability Mechanisms The results show that stability did not require an invariant connectome or a single trajectory of sparsity, weight sign, or mean connection strength Some controllers benefited from later-born neurons, whereas others remained effective when those neurons were removed The evolved CPPNs nevertheless almost always incorporated developmental time into their generated connectivity The study shows that a compact connectivity generator conditioned on developmental time can preserve visuomotor function while a recurrent neural substrate undergoes repeated topological changes and continuous changes in geometry and intrinsic dynamics These results extend generative neuroevolution from density scaling and morphology-conditioned control to functional connectivity across changing neural substrates The framework provides a basis for studying artificial neural networks as developing systems and for asking which growth programs, substrate organizations, and biological constraints allow behavior to remain effective during neural development Page 3 --- Learning Time-Varying Connectomes for Stable Behavior Across Development Christof Fehrman1, Jacob J.

Ines: Morra1 and Eva A.

Marcus: Naumann1 1 Neurobiology, Duke University, Durham, 27710, NC, USA.

Ines: Abstract Neural circuits must maintain functionality to drive effective behavior while their size, topology, geometry, and intrinsic dynamics change across development To model developing visuomotor circuits and behavior we investigated whether a single compact generative encoding could produce functional recurrent controllers across such changes Building on the HyperNEAT algorithm we represented this program as a compositional pattern-producing network that received developmental time as an input to generate age-specific connectivity The developmental substrate prescribed neuronal birth, position, sensory organization, and intrinsic time constants We tested this approach using two geometrically distinct developmental substrates and two visuomotor tasks optomotor responses and phototaxis Controllers optimized at only the initial or mature substrate generally failed when evaluated at other ages In contrast controllers optimized across multiple developmental snapshots maintained substantially higher and more consistent performance across trained and unseen ages Optimization at only three developmental snapshots was often sufficient to produce effective behavior across the tested developmental interval The resulting connectomes changed substantially with age and did not converge on a single trajectory of sparsity or connection-weight statistics Controllers also differed in whether they relied on neurons born later in development These results demonstrate that a shared spatiotemporal time-varying connectivity program can produce recurrent neural networks that preserve behavior across substantial developmental changes Together these results provide a framework for studying how functional stability can emerge without requiring structural or dynamical stability Page 4 --- Introduction Neural development involves the birth and maturation of neurons, the formation and elimination of synapses, changes in neuronal position and morphology, and continuing refinement of intrinsic and synaptic properties

1, 2: Neural development should therefore be understood not merely as the construction of a mature nervous system but as a process that sustains useful computation along the path to maturity Preserving behavioral function across development does not require the underlying circuit to remain unchanged Functional continuity cannot be inferred from architectural similarity or parameter preservation alone and must instead be evaluated at the level of behavior Representing an entire developmental trajectory of connectomes creates an additional challenge This creates a “genomic bottleneck” through which the information required to construct much larger neural systems must pass Hypernetworks provide an analogous computational strategy in which one network generates parameters for another, typically larger network This perspective motivates the more specific hypothesis that developing connectomes possess compressible spatiotemporal structure that can be represented directly as a function of neural geometry and developmental time Because each developmental stage modifies the preceding network both connectome structure and the neural activity it supports are expected to exhibit temporal continuity rather than vary independently across ages Page 5 --- Sensory Obs.

Paper summary: Ines: So we're looking at this paper, "Learning Time-Varying Connectomes for Stable Behavior Across Development." The main idea here is that neural circuits have to keep working effectively while their size, shape, and how fast things happen change as they develop.

Marcus: Right. And this study investigates if you can use a single compact generative encoding to create recurrent controllers that stay functional across all those developmental changes. It's trying to figure out if you need structural or dynamical stability for behavior to remain stable during development.

Yuki: From a population genetics view, it’s interesting because we see how species adapt over time, and this paper suggests the underlying computational structure can be flexible enough to handle those massive internal shifts. It's about how functional continuity emerges without needing a fixed architecture or fixed dynamics across ages.

Ines: Exactly. The researchers hypothesized that developing connectomes have a compressible spatiotemporal structure that they can represent directly as a function of neural geometry and developmental time. They tested this using two different geometric layouts for the brain and two specific tasks, optomotor responses and phototaxis.

Marcus: And the optimization strategy they used was to treat developmental functional stability as a trajectory-level optimization problem. They evolved a compact connectivity generator that takes neural geometry and developmental time as inputs to generate the connectivity for the substrate at any point in development.

Yuki: That sounds like they were trying to build a system that learns how to generate connections across a whole timeline, not just once at the end of growth. It’s about training it across different ages.

Ines: And their performance results were really telling. Controllers optimized only at one developmental endpoint generally failed when you tried to test them at other ages. But controllers optimized across development maintained substantially higher and more consistent fitness over the entire developmental interval, regardless of the substrate geometry or task they were tested on.

Marcus: So they found that stability didn't rely on having an invariant connectome, or just one trajectory of sparsity or weight sign. Some controllers even did better when they relied on neurons born later in development, while others worked fine even if those later neurons were removed.

Yuki: That suggests that the way the network learns to change its structure over time is more important than locking down a specific set of connections at any single moment. It points toward a dynamic generation process being key for survival during development.

Ines: So, in conclusion, the paper "Learning Time-Varying Connectomes for Stable Behavior Across Development" shows that you can use a compact connectivity generator conditioned on developmental time to preserve visuomotor function even when the neural substrate undergoes repeated topological changes and continuous shifts in geometry and dynamics.

Marcus: It’s a framework that extends generative neuroevolution from just density scaling or morphology-conditioned control to functional connectivity across changing neural substrates. This gives us a way to study artificial neural networks as developing systems, asking what growth programs allow behavior to remain effective during development.

Yuki: For the wider world, this suggests that biological systems might be inherently designed with a mechanism for functional stability that isn't dependent on perfect structural rigidity from day one. It opens up questions about which growth programs and substrate organizations allow behavior to persist through neural maturation.

Conclusion: Ines: So we're talking about "Learning Time-Varying Connectomes for Stable Behavior Across Development" by Fehrman, Morra, and Naumann. This paper looks at how a single program can keep a neural circuit working even as its physical structure completely changes during growth.

Marcus: Yeah, what they did is they built this generative encoding that takes developmental time as an input to create the network's connections for any point in time. It’s not about one snapshot; it’s about learning how to generate the whole timeline of connections.

Yuki: From a population genetics standpoint, this suggests that functional continuity isn't tied to a static blueprint. Instead, it seems like there's an underlying temporal rule that guides the structure toward the right behavior across different ages.

Ines: Exactly. It means we don't need to track every single synapse being born or killed perfectly at every moment in development for the circuit to succeed functionally. Stability emerges from this shared spatiotemporal program, not from having a fixed architecture.

Marcus: And they showed that this stability didn't require the network's structure—the actual connections—to be constant, or even for things like sparsity or connection strength to follow a single simple path. Some controllers actually did better when they relied on neurons that were born later in development.

Yuki: That’s interesting because it implies the developmental program is more flexible than we thought, allowing different structural programs to lead to the same functional outcome. It supports the idea that behavior can be preserved through diverse connectivity paths.

Ines: So what this means for us is that when we look at real development, we shouldn't just be looking for one perfect structure, but rather understanding the rules of generation itself—what constraints allow a network to remain effective across massive structural changes.

Marcus: And this paper offers a way to model artificial neural networks as developing systems, showing how they can achieve functional continuity without needing structural stability at every stage. We’ll dig into what these kinds of generative programs mean for designing next-generation AI architectures next.

More episodes

← Home