Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry
summary
The gist
The Strong Platonic Representation Hypothesis suggests that representational convergence in artificial neural networks can be harnessed constructively…
In short
The study tested if subject-specific brain embeddings can be translated across different people using only their internal geometric structure, without needing paired data between subjects. The method successfully recovered an approximately isometric shared neural geometry, proving that individual brain representations are compatible with a common coordinate system for transfer learning.
Key concepts
- Subject-Specific Embeddings
- These are low-dimensional numerical representations of brain activity learned from a single person's fMRI data based on their unique patterns. The researchers used these to see if they could be understood or mapped onto other people's data without any direct comparison between the subjects.
- Orthogonal Rotations (Rs→t)
- These are mathematical transformations used to find the specific way one subject's embedding space relates to another subject's. The method uses these rotations, derived from geometry-based pseudocorrespondences, to align the individual spaces into a single shared coordinate system.
- Isometric Shared Geometry
- This means that the underlying geometric structure of brain representations across different subjects is nearly identical or perfectly preserved. Finding this shared geometry suggests that even though individual brains have unique patterns, they share a fundamental, universal spatial organization.
Terminology used across episodes
This episode discusses
- Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry · Paper Radio
- mini-vec2vec: Scaling Universal Geometry Alignment with Linear Transformations
- Representation Learning with Contrastive Predictive Coding
The paper
Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry · Read on arXiv
University of Barcelona · Cornell University · Bellvitge Institute for Biomedical Research, Spain
The Strong Platonic Representation Hypothesis suggests that representational convergence in artificial neural networks can be harnessed constructively: embeddings can be translated across models through a universal latent space without paired data. We ask whether an analogous geometry can be recovered across human brains. Using fMRI data from the Natural Scenes Dataset, we propose a self-supervised encoder that learns subject-specific embeddings from brain data alone by exploiting repeated stimulus presentations. We show that these independently learned spaces can be translated across subjects using unsupervised orthogonal rotations, without paired cross-subject samples or intermediate model representations. Synchronizing pairwise rotations into a single shared latent space further improves cross-subject retrieval. These results provide evidence for a shared geometry in learned representations of human visual responses: subject-specific fMRI embeddings can be aligned across individuals within a common coordinate system.
Transcript
Introduction to the show: ident: Genomics Radio. Generated commentary on the latest computational biology and genomics papers.
Ines: I'm Ines.
Marcus: And I'm Marcus, here with Yuki.
Ines: We're looking at the paper: "Platonic Representations in the Human Brain".
Marcus: Here's the gist of the paper. The Strong Platonic Representation Hypothesis suggests that representational convergence in artificial neural networks can be harnessed constructively: embeddings can be translated across models through a universal latent space without paired data.
Ines: This paper investigates whether an analogous geometry can be recovered across human brains using fMRI data.
Marcus: Problem Setup The core problem addressed is testing whether subject-specific fMRI embedding spaces can be translated across subjects using only their intrinsic representational geometry.
Ines: Subjects observe disjoint image sets independently sampled from a distribution D, with no shared images or paired cross-subject correspondences available for learning the translations.
Title and authors: Ines: So this paper is called Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry. It suggests that the way our brains encode things has a universal shape that we can actually recover using just fMRI data from natural scenes, without needing any paired data between subjects.
Marcus: What I’m hearing is they are testing if these subject-specific brain embeddings can be translated across different people using only the intrinsic geometry of those responses, without ever seeing images that belong to both subjects at the same time.
Yuki: It sounds like they are asking if there's a common mathematical structure underlying how different people see and encode natural scenes, and this paper proposes a way to find that structure directly from brain scans.
Ines: Exactly. The core idea is that you can learn embeddings for each subject separately, just by showing them many repeated images, and then use those learned shapes to figure out the relationship between subjects without needing any shared images or training data linking them together initially.
Marcus: They propose a self-supervised encoder that learns these subject-specific fMRI embeddings from repeated stimulus presentations, using voxel reliability weighting and a low-dimensional linear projection with principal component analysis.
Yuki: And then they move on to the next step, which is estimating pairwise brain-to-brain translation estimates called orthogonal rotations, based on geometry derived pseudocorrespondences.
Ines: That’s where things get interesting because it sounds like they are using these geometry-derived pseudocorrespondences to estimate those orthogonal rotations between subjects without having any actual paired cross-subject data for the learning step.
Marcus: They refine those pairwise rotation estimates iteratively, similar to a method called Iterative Closest Point, which is a way to align shapes when you don't have perfect matches.
Yuki: Then they take those pairwise rotations and synchronize them into a single shared latent space by solving an orthogonal synchronization problem over the dimension d, which recovers one rotation per subject mapping all embeddings into a common coordinate system.
Ines: So what they’re doing is taking these independently learned subject spaces and making sure they fit together in one big, shared coordinate system by finding those pairwise rotations for every single person involved.
Marcus: The evaluation was done on the Natural Scenes Dataset, using subject-specific non-shared images to learn the encoders and brain-to-brain translations. They measured performance across two settings: within subjects and across subjects.
Yuki: For within subjects, they found that the embeddings are stable, with an average rank of five point twenty-eight which suggests that even if we look at the same person’s data over time, their representation stays consistent.
Ines: But when they looked across subjects, the synchronization improved retrieval metrics from a score of two point forty-seven to one point ninety-seven and R at one from zero point seventy nine to zero point eighty three. That improvement tells us that aligning these spaces helps them find the right images for each other much better.
Title and authors: Marcus: The results support the existence of an approximately isometric shared neural geometry recoverable directly from fMRI data, which means subject-specific spaces are compatible with a common coordinate system, according to page two of this paper <ref:2605.20496#pg1>.
Yuki: That’s significant because it suggests that we don't need shared stimuli to see if two brains are fundamentally organized in a similar way.
Ines: It has practical implications for cross-subject neural modeling because it means data and encoders learned in one subject can be transferred to another, reducing the need for extensive subject-specific calibration when you move from fMRI to image decoding or vice versa.
Marcus: But they also made a distinction about model brain alignment, suggesting that model features aren't necessarily related by the same near-isometric transformations across subjects.
Yuki: That’s important because it separates the idea of geometric equivalence from what actually happens when you train an AI model on top of those brain representations.
Ines: So, to wrap up this Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry paper, they conclude that subject-specific embeddings learned from brain data alone can be translated across individuals using unsupervised orthogonal rotations without needing paired cross-subject samples.
Marcus: They also found that synchronizing those pairwise rotations into a single shared latent space further indicates that the recovered subject spaces are approximately isometric.
Yuki: That means we can use this method to build a common framework for understanding encoding and pattern component analysis across different subjects, which is what page two of this paper suggests <ref:2605.20496#pg1>.
Ines: It’s a big step because it moves us toward being able to transfer knowledge learned in one person’s brain to another person’s without needing their specific data again.
Marcus: For future work, the authors flag that the method relies on high-quality fMRI data and that the unpaired translation procedure can be sensitive depending on how you initialize those rotations.
Yuki: So while they found this geometry in this setting, they also noted that similar isometries might not hold if we test it in lower signal-to-noise modalities or with stimulus distributions further away from what was used in the Natural Scenes Dataset.
Ines: It’s a necessary caution, because if you apply these findings to other types of data or different visual tasks, that assumed near-isometric relationship might break down.
Marcus: In short, they’ve shown that subject-specific embeddings learned from brain data alone can be translated across individuals using unsupervised orthogonal rotations without paired cross-subject samples.
Yuki: It really suggests a level of universality in the organization of visual processing that is independent of the specific training data used for each individual.
Marcus: For future work, they flag that the method relies on high-quality fMRI data and that the unpaired translation procedure can be sensitive depending on how you initialize those rotations.
Ines: It’s a necessary caution, because if you apply these findings to other types of data or different visual tasks, that assumed near-isometric relationship might break down.
The paper's summary: Ines: So, we're looking at how this paper summarizes its main finding for us. It basically says that even though each person’s brain has its own unique map of what they see, there’s an underlying geometric structure common to all of them.
Marcus: Right. They’re not talking about the actual images themselves, but the mathematical shape of how those images get encoded in the brain scans. They learned subject-specific embeddings from repeated views and then figured out how to translate those across subjects without any paired data between them.
Ines: That’s the core claim: you can map these independent subject spaces into one shared latent space just by figuring out the right orthogonal rotations between them using geometry derived pseudocorrespondences. It means that the distance relationships in one person's brain representation are preserved when you translate it to another person's brain representation.
Marcus: Exactly. The numbers they found were pretty compelling for this part of the math. They showed that within a single subject, the embeddings stay stable, with an average rank of five point two eight, which means their representation doesn't drift much over time.
Ines: But across subjects, when they synchronized those spaces by solving that orthogonal synchronization problem over the dimension d, retrieval metrics got better. They went from two point four seven to one point nine seven for cross-subject retrieval R at one going from zero point seventy nine to zero point eighty three.
Marcus: And that improvement suggests that aligning these spaces actually helps you find the right images much better when you're trying to match brain activity across different people. It supports the idea that subject-specific spaces are compatible with a common coordinate system.
Ines: This has big implications for how we think about neural modeling, Marcus. If you can translate data and encoders learned in one person to another, you don't need to do all that extensive subject-specific calibration every single time you move from fMRI data to image decoding or vice versa.
Marcus: That’s the practical part. It suggests that the underlying structure of visual perception is more universal than we thought, even if the specific pathways differ between individuals. But they did put a stop to it too.
Ines: They made a distinction about model brain alignment, which is important because it suggests that just because neural embeddings are geometrically related doesn't mean the features in an actual AI model are related by those exact same near-isometric transformations across subjects.
Marcus: So, the geometry is there, but it's not a one-to-one mapping for what we see in deep learning models. They’re looking at different things here—the brain structure versus the learned weights of an artificial system.
Ines: And they did flag some limitations too. The method relies on high quality fMRI data, and the way they do that unpaired translation procedure can be sensitive depending on how you initialize those rotations.
Marcus: True. It’s not a plug-and-play solution for any dataset you throw at it without careful tuning of the starting point for those transformations. But overall, they've shown that subject-specific embeddings learned from brain data alone can be translated across individuals using unsupervised orthogonal rotations without needing paired cross-subject samples.
Ines: It really does suggest a level of universality in the organization of visual processing that is independent of the specific training data used for each individual.
The paper's improvements: Tom: So, we’re talking about how the authors suggest they can actually make this method better than what they first proposed. It sounds like they’re looking for ways to refine those rotations and synchronization steps.
Ines: Right. They mention that the method works best when you use high quality fMRI data, which is a big caveat for us, but they also point out that the unpaired translation procedure can be sensitive depending on how you set up those initial rotations.
Marcus: So what they’re saying is that if you want to use this across different datasets or modalities, like maybe lower signal-to-noise data, you need to be extra careful with how you start the process. You can't just throw any initialization at it and expect a good result.
Ines: That makes sense because they’re working with these geometry derived pseudocorrespondences, and if those initial geometric guesses are off by even a little bit, the whole synchronization into that shared latent space might get messy. They need robust methods for getting that starting point right.
Marcus: And they also hint at the future work there. They suggest testing whether this kind of isometry—this near-perfect shared geometry—actually holds up if you move to different stimulus distributions or even lower signal-to-noise modalities than what they used on the Natural Scenes Dataset.
Ines: That’s a big question for the biology side. If this universal geometry we found only works well for natural scenes, does it mean that when we look at human brains responding to something completely different, like a medical scan or a synthetic visual task, this specific kind of shared structure might disappear?
Marcus: And that brings us back to the model brain alignment part. They’ve shown this geometric equivalence in the neural embeddings, but they’re still separating that from what happens when you look at actual AI models. The geometry is one thing, but how an AI learns its weights isn't necessarily governed by these same near-isometric transformations across subjects.
Ines: Exactly. So the implication is that while we can transfer data and encoders between people using this geometric alignment, we shouldn't assume that the underlying functional mapping in a machine learning model will follow those exact same rules when it’s being compared across different subjects or tasks.
Marcus: It means the utility of this method is really focused on cross-subject neural modeling, but it doesn't claim to solve the whole problem of how AI learns representations from scratch. They’re showing a tool for aligning brain data, not a complete theory of general learning transfer.
Ines: So, the takeaway is that we have a way to see if two brains are fundamentally organized in a similar way just by looking at their response geometry, but we have to be cautious about applying that finding outside of natural scenes and remember the difference between neural geometry and artificial model weights.
Conclusion: Ines: So we’re wrapping up this look at "Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry." It really boils down to showing that subject-specific embeddings learned from fMRI data can be translated between individuals using just geometry derived pseudocorrespondences, without needing any paired cross-subject images.
Marcus: Right. The big deal is that this suggests an approximately isometric shared neural geometry is recoverable directly from the fMRI data, meaning the spaces learned for one person are compatible with a common coordinate system across everyone.
Yuki: From a population perspective, it’s interesting because it suggests that even though individual brain responses vary, there's a deep structural similarity in how those responses are organized across different people. It supports the idea that there's some underlying universal organization to visual processing.
Ines: That’s what I was thinking. It means we can actually use data and encoders learned in one subject for another person, which is a massive practical thing if we ever want to do cross-subject neural modeling without needing tons of extra calibration time.
Marcus: It definitely opens up the door for more efficient transfer learning in neuroscience, but remember they also pointed out that model brain alignment isn't necessarily related by those same near-isometric transformations across subjects. That’s a key distinction we have to keep in mind.
Yuki: I just wonder if this universal geometry holds up when we test it on stimulus distributions that are really different from the natural scenes they used for the Natural Scenes Dataset, because that could be a limiting factor for its broader application in population genetics.
Ines: True. That’s the caveat—the method relies on high quality fMRI data and is sensitive to initialization of those rotations, so we can't just assume it works everywhere without careful setup. But the core finding about translating subject spaces remains strong even with those limitations.
Marcus: So, to sum up, they’ve shown that subject-specific embeddings learned from brain data alone can be translated across individuals using unsupervised orthogonal rotations without paired cross-subject samples. It's a way to see if two brains are fundamentally organized in a similar way through their response geometry.
Yuki: I think the real impact here is showing that we don't always need shared stimuli to find universal structures in the brain, which is a big conceptual step for population studies.
Ines: Exactly. This work on "Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry" gives us a new tool to test these geometric hypotheses directly from brain data alone.
Marcus: It’s a powerful technique for aligning subject spaces, but we need to keep an eye on those caveats about initialization and the quality of the fMRI signal when we try to apply it in more complex or diverse settings.
More episodes
- 2610.33881-Sensorimotor behavior from an untrained brain-and-nerve-cord connectome
- 2610.40344-Morphological Features of Murine Pulmonary Arterial Networks for Diagnosing Vascular Disease
- Daily Summary for 2026-11-19
- 2609.10193-Are You Learning Biological Signal or Shortcuts? Auditing and Mitigating Bias in Protein-Protein Interaction Datasets
- 2610.38236-Generative discovery of chemical reaction networks
- 2507.11176-An Interpretable AI framework Quantifying Traditional Chinese Medicine Principles Towards Enhancing and Integrating with Modern Biomedicine
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- 2504.03590-Towards a Unified Framework for Determining Conformational Ensembles of Disordered Proteins
- 2603.15217-A multiscale discrete-to-continuum framework for structured population models