Learning Deep Phylogeny Through Epistasis-Aware Geometry

summary

The gist

HyperEvoGen introduces a hyperbolic generative framework that couples a variational autoencoder with biologically informed training objectives to address representation learning…

In short

HyperEvoGen uses a hyperbolic variational autoencoder with biologically informed losses to learn protein evolution. It employs a hyperbolic latent space to preserve phylogenetic structure, creating distances that scale with true evolutionary divergence. This method accurately models sequence variation and enables fast ancestral sequence reconstruction, outperforming traditional methods at deeper evolutionary scales.

Key concepts

Hyperbolic Latent Space
The model uses an n-dimensional Poincaré ball geometry instead of standard Euclidean space. This choice is crucial because protein evolution is tree-like; hyperbolic space naturally accommodates hierarchical branching structures without distorting relationships, unlike Euclidean spaces which struggle with deep branches.
Compound Loss Function
Training combines the standard VAE loss with three biological terms: an adversarial loss to match empirical distributions, a covariance loss to capture residue dependencies (epistasis), and a correlation loss to align latent distances with observed p-distances. This forces the model to learn representations that reflect real evolutionary constraints.
Geodesic Ancestral Sequence Reconstruction
Ancestors are inferred by placing them as midpoints along hyperbolic geodesics connecting extant sequence embeddings. This method respects the global structure learned during training, allowing for more accurate reconstruction of ancestral proteins, especially when divergence is high.

Terminology used across episodes

This episode discusses

The paper

Learning Deep Phylogeny Through Epistasis-Aware Geometry · Read on arXiv

Institute for Genomics and Evolutionary Medicine, Temple University · Computer and Information Sciences, Temple University · Institute for Computational Molecular Science, Temple University · Department of Biology, Temple University

Transcript

Introduction to the show: ident: Genomics Radio. Generated commentary on the latest computational biology and genomics papers.

Ines: We're looking at the paper: "Learning Deep Phylogeny Through Epistasis-Aware Geometry".

Marcus: Here's the gist of the paper. HyperEvoGen introduces a hyperbolic generative framework that couples a variational autoencoder with biologically informed training objectives to address representation learning, evolutionary distance estimation, and ancestral sequence reconstruction.<ref:2604.22997#pg19> The arrangement of protein sequences in HyperEvoGen’s hyperbolic embedding aims to preserve phylogenetic structure and produce latent distances which scale with true evolutionary divergence<ref:2604.22997#pg4> This combination of accuracy and throughput supports large-family evolutionary studies and accelerates design-oriented applications<ref:2604.22997#pg2> HyperEvoGen enables fast, scalable modeling of protein evolution while preserving hierarchical relatedness in a geometry-aware representation<ref:2604.22997#pg2> The Core Innovation of the Latent Space A central innovation of HyperEvoGen is the use of a hyperbolic latent space, implemented as an n-dimensional Poincar´e ball, to encode protein sequence variation<ref:2604.22997#pg4> Protein evolution is fundamentally tree-like, with lineages branching and diversifying over time<ref:2604.22997#pg2> Euclidean latent spaces struggle to represent hierarchies without distortion because Euclidean volume and distances grow only polynomially with radius; as a result, deep branches become “crowded” near the boundary and large evolutionary separations are compressed<ref:2604.22997#pg4> Hyperbolic space, by contrast, expands exponentially with radius, naturally accommodating tree-like structures<ref:2604.22997#pg2> The Brownian/Yule trajectory experiments make this geometric mismatch explicit: Euclidean distances between tips systematically underestimate patristic path lengths, whereas hyperbolic embeddings preserve a much tighter relationship with true distances along the tree<ref:2604.22997#pg4> How the Training Signal is Built Model training uses a compound loss function that combines the standard VAE objective with three additional biologically motivated terms<ref:2604.22997#pg2> The total training objective is the sum of all these components: the VAE reconstruction–KL loss (ELBO) plus the critic’s Wasserstein loss, the covariance loss, and the correlation loss<ref:2604.22997#pg2> 1.

Ines: The adversarial critic provides a Wasserstein loss that pushes reconstructed sequences towards the empirical distribution<ref:2604.22997#pg2> 2.

Marcus: A covariance-based term is included to capture epistatic dependencies between residue positions<ref:2604.22997#pg2> 3.

Ines: A divergence correlation loss aligns distances in the latent space with observed p-distances for nearby sequences<ref:2604.22997#pg2> Where the Gains Come From The covariance matching loss penalizes the model if it fails to reproduce the pairwise co-occurrence patterns present in real protein sequences, thereby biasing the VAE to allocate latent capacity to epistatic interactions<ref:2604.22997#pg2> The divergence correlation loss explicitly encourages the former behavior by maximizing the Pearson correlation over all pairwise distances in the batch<ref:2604.22997#pg2> HyperEvoGen’s embeddings maintain a nearly linear correspondence with true evolutionary distances over a broad range of divergences, mitigating the saturation problem that afflicts simple sequence dissimilarity measures<ref:2604.22997#pg2> The model-based geometry shows a characteristic crossover: inferior accuracy at very low divergence but consistently superior accuracy at moderate to high divergence, overtaking ML at 0.2–0.3 p-distance<ref:2604.22997#pg2> Ancestral Sequence Reconstruction HyperEvoGen performs ASR as a generative decoding problem in a continuous latent space that has been trained to capture global sequence statistics under an epistatic Potts model<ref:2604.22997#pg2> Once extant sequences are embedded, ancestors are placed by interpolating along hyperbolic geodesics between child embeddings; the latent midpoint, estimated by sampling along the geodesic, is then decoded into an amino-acid sequence<ref:2604.22997#pg2> This procedure implicitly respects the global structure of the landscape and the couplings encoded during training<ref:2604.22997#pg2> HyperEvoGen’s approach to ancestral sequence reconstruction is also distinct from conventional methods<ref:2604.22997#pg2> As divergence increases and the assumptions of those models are progressively violated by multiple hits and epistasis, HyperEvoGen’s geodesic ASR overtakes ML, yielding lower MRCA reconstruction error and better root sequence recovery across a variety of tree topologies<ref:2604.22997#pg2> The superior performance of HyperEvoGen for deep ancestors suggests that this geometric picture is not merely aesthetic but carries real inferential advantages<ref:2604.22997#pg2> Limitations and Future Directions All quantitative evaluations are performed on synthetic data generated from Potts models inferred on a single Pfam family (PF00069) and evolved along Yule trees<ref:2604.22997#pg2> The Potts model itself, inferred from a curated alignment, is an approximation to the true fitness landscape and may omit higher-order interactions or rare but functionally important states<ref:2604.22997#pg2> Several design choices in HyperEvoGen are currently heuristic<ref:2604.22997#pg2> A more systematic exploration of these hyperparameters, or approaches that learn them directly from data (for example, by optimizing clade recovery or ASR accuracy on held-out simulations), could further improve robustness and generality<ref:2604.22997#pg2> Incorporating Bayesian treatments of latent positions, sampling over geodesic paths, or integrating branch length information could yield richer estimates with credible intervals rather than single-point reconstructions<ref:2604.22997#pg2> HyperEvoGen represents, to our knowledge, the first integrated framework that deploys a hyperbolic generative model with biologically informed losses for simultaneous sequence generation, phylogenetic inference, and ancestral reconstruction<ref:2604.22997#pg2> The paper is 5 pages long and contains 20 references.

Paper summary: Ines: So, summarizing this paper "Learning Deep Phylogeny Through Epistasis-Aware Geometry," they propose a framework using a Poincaré variational autoencoder with adversarial training and hyperbolic latent geometry to map protein sequences. They claim this approach preserves phylogenetic structure and generates latent distances that match true evolutionary divergence one <ref:2604.22997#pg1>.

Marcus: The authors use a compound loss function that mixes the standard VAE loss with terms for covariance and correlation to ensure the representation learns biologically meaningful features, like epistatic dependencies two <ref:2604.22997#pg1>. This allows them to build embeddings where the geometry actually reflects evolutionary constraints.

Yuki: Ultimately, this framework enables ancestral sequence reconstruction by interpolating along hyperbolic geodesics between extant sequences two <ref:2604.22997#pg1>. It offers a way to infer ancestral proteins by traversing these constrained regions of the latent space seventeen.

Ines: The paper suggests that this geometric modeling outperforms machine learning at moderate to high divergence levels, and it shows advantages in reconstructing deep ancestors when sequence evolution becomes complex due to multiple hits and epistasis eleven.

Marcus: They acknowledge that their synthetic data comes from a Potts model approximation, so the real-world applicability depends on how well that model reflects actual protein fitness landscapes two <ref:2604.22997#pg1>. They also flag that some of the design choices they made are still heuristic and need more systematic exploration two <ref:2604.22997#pg1>.

Yuki: So, while it provides a powerful tool for inferring deep phylogeny and ancestral sequences under those specific modeling assumptions, we should treat the results with caution until we see how this holds up on more diverse datasets two <ref:2604.22997#pg1>.

Conclusion: Ines: So we’ve seen how they used a hyperbolic space and some clever math to figure out evolutionary trees without getting lost in the noise of real protein evolution, and now we’re looking at what this paper is actually trying to say about those methods.

Marcus: It’s titled "Learning Deep Phylogeny Through Epistasis-Aware Geometry," and it basically says they built a model that keeps the shape of evolution intact by using geometry that matches how proteins actually mutate.

Ines: What they did was use a variational autoencoder with this hyperbolic embedding, and their main goal was to get latent distances that actually scale with how much time has passed in evolution. It’s about making sure the distance between two sequences in their model reflects the real evolutionary divergence between them.

Marcus: The authors used a compound loss function, not just one simple thing, they added terms for covariance and correlation so the model learns those tricky dependencies—the epistasis—between different parts of a protein that influence each other during evolution.

Yuki: For me, what this means is that when we look at a tree of related proteins, this model isn't just drawing lines between them; it’s capturing the underlying physical constraints on how those proteins actually evolve over time in a way that respects their functional relationships.

Ines: Exactly. It changes the perspective from just seeing sequence differences to understanding the geometric pathway those sequences took through evolutionary history.

Marcus: The implication is that we might be able to do ancestral sequence reconstruction much more reliably, especially when we’re dealing with deep branching events where simpler models start to break down.

Yuki: And that’s huge for population genetics too; it gives us a better way to infer the historical structure of protein families, which tells us a lot about how those species diversified over millions of years.

Ines: They did show that when divergence gets high, this geometric approach actually beats some other machine learning methods for reconstructing ancestors, which is a pretty big deal for inferring deep history.

Marcus: But they did have to be careful with the training data—it came from a specific Potts model simulation, so we gotta remember that the fidelity of their results is tied to how well that initial model approximates real protein fitness landscapes.

Yuki: Right, so it’s not a magic answer, but it shows a new way to approach these complex evolutionary questions by using geometry to guide the learning process.

Ines: Exactly. And while they flag some of their choices as heuristic, this framework is pushing the boundary for how we use generative models to understand deep biological history.

Marcus: It’s definitely worth watching because it connects the abstract geometry of a space directly to the concrete problem of protein evolution and sequence divergence.

More episodes

← Home