BioBlobs: Unsupervised Discovery of Functional Substructures
summary
The gist
Protein function is driven by cohesive substructures, such as catalytic triads, binding pockets, and structural motifs…
In short
BIOBLOBS compresses protein function prediction by identifying small, cohesive substructures called 'blobs' instead of using all residues. These blobs adapt their size to the task, finding everything from local active sites to large domains. The method learns which substructures drive function and can recover known functional sites without needing residue-level labels.
Key concepts
- Blobs
- These are small, cohesive substructures within a protein that are hypothesized to be responsible for its specific function. Instead of analyzing the entire protein sequence, BIOBLOBS focuses on these small regions, which can range in size from just a few residues to large structural domains.
- Neural Blob Partitioner
- This module proposes and defines the location and properties of these functional blobs. It works by selecting initial 'seed' residues and then growing them into soft regions using learned compatibility scores and distance measures, determining membership based on both semantic similarity and spatial proximity.
- Hoyer’s Scale-Invariant Sparseness Measure
- This is a regularization technique used during training to ensure the partitioner doesn't select too many candidates in any area. It forces the system to discover a minimal, sufficient set of residues for function prediction, promoting efficient and accurate functional substructure discovery.
- MIL Decoder
- This module takes the evidence from all discovered blobs and aggregates it to make a final prediction about the entire protein's function. It treats each blob as an instance of data, learning how to combine their individual contributions into a single, robust protein-level output.
Terminology used across episodes
This episode discusses
- BioBlobs: Unsupervised Discovery of Functional Substructures · Paper Radio
- Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
- Endowing Protein Language Models with Structural Knowledge
- Categorical Reparameterization with Gumbel-Softmax
- Graph Pooling for Graph Neural Networks: Progress, Challenges, and Opportunities
- VenusX: Unlocking Fine-Grained Functional Understanding of Proteins
- A Survey on Protein Representation Learning: Retrospect and Prospect
- DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity Measures
- Protein Representation Learning by Geometric Structure Pretraining
The paper
BioBlobs: Unsupervised Discovery of Functional Substructures · Read on arXiv
Xin Wang, Kaiwen Shi, Carlos Oliver
Vanderbilt University · Yale University
Protein function is often localized to cohesive substructures, such as catalytic triads, binding pockets, and structural motifs, that occupy only a small fraction of a protein's residues. Yet existing predictive pipelines typically aggregate residue-level embeddings and do not explicitly model or infer these functional substructures, leaving the central biological question unanswered: which substructure of a protein is responsible for its function? We introduce BioBlobs, an encoder-agnostic, end-to-end differentiable framework that compresses a protein into a small set of cohesive substructures (blobs) and predicts function from these blobs alone, so that each blob corresponds to a candidate functional region. Across diverse protein function prediction tasks and both sequence-only and structure-aware protein language models, BioBlobs is competitive with strong baselines while operating on only a small fraction of residues. Trained only on protein function labels, BioBlobs recovers expert-curated functional sites in InterPro and experimentally annotated catalytic sites in the Mechanism and Catalytic Site Atlas, demonstrating unsupervised functional substructure discovery and opening a path to large-scale functional site discovery in unannotated proteins. The discovered blobs adapt their spatial scale to the task, ranging from local catalytic sites to entire structural domains. Code is available at https://github.com/OliverLaboratory/BioBlobs.
Transcript
Introduction to the show: ident: Genomics Radio. Generated commentary on the latest computational biology and genomics papers.
Ines: We're looking at the paper: "BioBlobs: Unsupervised Discovery of Functional Substructures".
Marcus: Here's the gist of the paper. Protein function is driven by cohesive substructures, such as catalytic triads, binding pockets, and structural motifs, that occupy only a small fraction of a protein’s residues Across diverse protein function prediction tasks and multiple sequence- and structure-based encoders, BIOBLOBS matches or exceeds strong baselines while operating on only a small fraction of residues.
Ines: The discovered blobs adapt their spatial scale to the task, ranging from local catalytic sites to entire structural domains.
Marcus: Pruning redundant reasoning tokens BIOBLOBS is an encoder-agnostic, end-to-end differentiable framework that compresses a protein into a small set of cohesive substructures (blobs) and predicts function from these blobs alone.
Ines: This approach addresses the central biological question of which substructure of a protein is responsible for its function.
Title and authors: Ines: So this paper introduces something called BioBlobs: Unsupervised Discovery of Functional Substructures. It basically suggests that we don't need to look at every single residue in a protein when figuring out what it does. Instead, function comes from these small, cohesive chunks, or blobs >
Marcus: Exactly. The core idea is compressing the whole protein into a small set of these blobs and then predicting the function based only on those blobs >
Ines: Right. They're saying that existing methods just give you per-residue embeddings, but those embeddings get diluted by all the surrounding non-functional stuff, so you lose sight of which specific part is actually doing the work >
Yuki: From a population genetics view, it makes sense because if we only look at one residue in isolation, that single measurement doesn't tell us much about the whole organism’s trait; we need to see how those functional units are organized across the structure >
Ines: The paper shows that these discovered blobs adapt their size based on what task you’re trying to do. They can be tiny local sites or they can span entire structural domains depending on what's needed >
Marcus: And that adaptation is key because it solves the problem of needing different sized regions for different biological functions, like a catalytic triad versus a whole binding pocket >
Yuki: That adaptability is interesting because it means this framework isn't locked into one type of biological mechanism; it can handle local things and big structural features depending on the prediction task >
Ines: They also show that you can use protein-level supervision—just knowing if the whole protein has a certain function—to find experimentally known catalytic sites without needing residue-level labels >
Marcus: That's a big deal for scaling up functional site discovery; it means we don't have to wait for expensive, residue-level data to even start looking for these important regions >
Yuki: If you can recover known catalytic sites just from the protein level label, that opens up a way to look at the entire unannotated proteome for functional clues >
Ines: The paper also discusses how they build their training signal, which involves two steps: seed selection and then expanding those seeds into soft, spatially local substructures using proximity bias >
Marcus: That expansion process uses both semantic compatibility and a distance-based proximity prior to decide if a residue belongs to a blob >
Yuki: I wonder how they manage the trade-off between finding enough blobs and not just making every small piece its own blob, given that the functional substructures are so small relative to the whole protein >
Ines: They use something called Hoyer’s scale-invariant sparseness measure to prevent the partitioner from absorbing too many candidates in each seed's neighborhood, which forces them to find a minimal set of residues >
Title and authors: Marcus: That regularization is what keeps the model from just being overly general and ensures it finds those actual functional spots rather than just random local clusters >
Yuki: So, when you look at the results on the M-CSA database, they scored catalytic residues using this method with a median accuracy of zero point nine two five against binary labels > <ref:2510.01632#pg1>
Ines: That comparison against a shuffled partition gives them zero point five zero one, and against an SASA baseline which assumes catalytic residues are buried gives them zero point six nine six > <ref:2510.01632#pg3>
Marcus: Those numbers suggest that this method is doing something substantial beyond just random chance or the existing simple baselines we're using right now >
Yuki: It’s interesting because they achieved this recovery using only protein-level supervision, which is a significant constraint for any biological discovery tool >
Ines: The paper also highlights that if you use attention-weighted alignment loss, you can push the partitioner and the prediction head to agree on which blobs are actually relevant for the final function prediction >
Marcus: That makes the blobs first-class units of computation, meaning their contribution is directly tied to whether or not they are used in the final result >
Yuki: So, if we think about this finding for biology, it means we can start mapping out functional relationships across massive datasets without needing perfect residue annotations upfront >
Ines: This whole framework is essentially reframing protein function prediction from analyzing a huge pool of residue embeddings to reasoning over a compact set of cohesive substructures >
Marcus: And the result is that they are matching or exceeding strong baselines on both ProteinShake and VenusX encoders while only looking at a small fraction of residues >
Yuki: It seems like this opens up a scalable path for discovering functional substructures across the entire unannotated proteome, which is huge for understanding evolution >
Ines: Overall, the main implication is that you can discover functionally relevant substructures without per-residue supervision, and that those blobs dynamically adjust their scale to match the specific biological task at hand >
Marcus: And they’ve shown that aggressive Hoyer regularization helps keep these blobs compact without losing accuracy, which makes them very efficient models computationally >
Yuki: It’s a solid result because it proves that functional information is indeed localized in these substructures, and this discovery process is robust across different types of protein encoders >
Ines: So to wrap up, the paper BioBlobs: Unsupervised Discovery of Functional Substructures gives us a way to predict function by reasoning over these small cohesive blobs that scale appropriately for the task >
Marcus: It’s powerful because it recovers known sites from just protein-level data and shows that these blobs are the true units of computation here >
Yuki: It really suggests that functional organization in proteins is hierarchical, with these smaller substructures building up to define a larger function across different scales >
The paper's summary: Ines: So we just talked about how these new blobs can adapt their size based on what you're trying to do, right? Now let's look at what this paper actually claims in its summary >
Marcus: Okay, so it boils down to this idea that protein function isn't driven by every single residue. instead, it’s driven by these small chunks called blobs that have a specific function >
Ines: Exactly. The paper says they compressed the whole protein into just a few of these blobs and predicted the function from those blobs alone >
Marcus: And this is important because it means you don't need to look at every single residue embedding anymore; you just need to focus on the functional regions >
Ines: They show that these discovered blobs adapt their spatial scale to the task, meaning they can be tiny local catalytic sites or they can be whole structural domains depending on what the prediction goal is >
Marcus: That adaptability is a huge deal because it solves a problem where you need different sized regions for different biological functions >
Ines: They also show that you can use only protein-level supervision—just knowing if the whole protein has a certain function—to find experimentally known catalytic sites without needing residue-level labels >
Marcus: That’s the big implication for scaling up discovery; it means we don't have to wait for expensive, residue-level data to even start looking for these important regions across the unannotated proteome >
Ines: The paper also details how they build their training signal, which involves two steps—seed selection and then expanding those seeds into soft, spatially local substructures using proximity bias >
Marcus: That expansion process uses both learned compatibility between the seed and a residue and a distance-based proximity prior to decide if that residue belongs to a blob >
Ines: They use something called Hoyer’s scale-invariant sparseness measure to stop the partitioner from absorbing too many candidates in each seed's neighborhood, forcing them to find just the minimal set of residues needed >
Marcus: That regularization is what keeps the model from being overly general and ensures it actually finds those specific functional spots rather than just random local clusters >
Ines: When they look at the results on the M-CSA database, they scored catalytic residues using this method with a median accuracy of zero point nine two five against binary labels >
Marcus: That comparison against a shuffled partition gives them zero point five zero one, and against an SASA baseline that assumes catalytic residues are buried gives them zero point six nine six >
Ines: Those numbers suggest the method is doing something substantial beyond just random chance or the existing simple baselines we're using right now >
Marcus: It’s interesting because they achieved this recovery using only protein-level supervision, which is a significant constraint for any biological discovery tool >
Ines: The paper also highlights that if you use attention-weighted alignment loss, you can push the partitioner and the prediction head to agree on which blobs are actually relevant for the final function prediction >
Marcus: That makes those blobs first-class units of computation, meaning their contribution is directly tied to whether or not they are used in the final result >
Ines: So, if we think about this finding for biology, it means we can start mapping out functional relationships across massive datasets without needing perfect residue annotations upfront >
Marcus: This whole framework is essentially reframing protein function prediction from analyzing a huge pool of residue embeddings to reasoning over a compact set of cohesive substructures >
Ines: And the result is that they are matching or exceeding strong baselines on both ProteinShake and VenusX encoders while only looking at a small fraction of residues >
Marcus: It seems like this opens up a scalable path for discovering functional substructures across the entire unannotated proteome, which is huge for understanding evolution >
Ines: Overall, the main implication is that you can discover functionally relevant substructures without per-residue supervision, and that those blobs dynamically adjust their scale to match the specific biological task at hand >
The paper's improvements: Tom: So we've seen how BioBlobs use protein blobs to predict function from small subsets of residues, and now let's talk about what the authors suggest they can do even better >
Ines: The paper points out that they can recover known experimental sites just from a protein-level label, which is a big deal for finding functional spots across the whole proteome >
Marcus: That recovery happens because the attention weight in their model is totally tied to the prediction, so catalytic residues naturally fall into those high-attention blobs >
Ines: They also showed that you can use attention weighted alignment loss, which makes the blobs first-class units of computation, so their contribution is directly tied to whether they are used in the final result >
Marcus: That means the partitioner and the prediction head are jointly pushed to agree on which blobs are fragment resident, which is a pretty tight coupling for learning >
Ines: They also found that aggressive Hoyer regularization compresses each blob size without sacrificing accuracy, leading to what they call near-free compactness >
Marcus: So they can keep the model accurate while making the discovered functional regions as small and efficient as possible computationally >
Ines: The authors note that they have shown this works across different types of protein encoders, which suggests this approach isn't tied to one specific way of representing a protein structure >
Marcus: That's key because if it works across different encoders, it means the functional substructures themselves are robust concepts that exist regardless of how you model them computationally >
Ines: But they also flag a limitation: the paper doesn't tell us exactly how to tune those scale parameters for every single protein type without some kind of task-specific guidance >
Marcus: That’s fair; they don't give a universal setting for the radius or the number of seeds, which means you still have to do some testing for each specific prediction task >
Ines: So what this changes for someone just listening is that we can start searching massive databases for functional clues using only protein-level info, even when we don't know where to start with the blob sizes >
Conclusion: Tom: So we’re wrapping up our take on BioBlobs: Unsupervised Discovery of Functional Substructures, and it really boils down to this idea that protein function is driven by these small, cohesive substructures called blobs >
Ines: Exactly. The paper reframes protein function prediction from looking at all the residue embeddings to reasoning over a compact set of functional units >
Marcus: And because these blobs adapt their size based on the task, they can find both local catalytic sites and entire structural domains, which is a big flexibility gain >
Yuki: From a population genetics view, this suggests that function isn't always defined by one single residue but by how those functional units are organized across the whole structure >
Ines: They proved that you can recover known experimental catalytic sites from just protein-level supervision, which is a significant step for finding functional sites in the unannotated proteome >
Marcus: That's powerful because it means we don't need to wait for residue-level data before we can even start looking for these important regions >
Yuki: It opens up a way to look at the entire unannotated proteome for functional clues, which is huge for understanding evolution and how functions might have been gained or lost over time >
Ines: The whole point is that these blobs are first-class units of computation because their attention weights are inseparable from the prediction, which makes them really useful tools >
Marcus: We saw the numbers on M-CSA were strong, median accuracy zero point nine two five against binary labels compared to a baseline of zero point five zero one >
Yuki: That level of recovery suggests that the biological signal is robust enough to be found even when you only have broad structural information >
Ines: The main implication is that you can discover functionally relevant substructures without per-residue supervision, and those blobs dynamically adjust their scale to match the specific biological task at hand >
Marcus: They also showed that aggressive Hoyer regularization helps keep these blobs compact without losing accuracy, which makes them very efficient models computationally >
Yuki: It’s a solid result because it proves that functional information is indeed localized in these substructures, and this discovery process is robust across different types of protein encoders >
Ines: So we have the BioBlobs framework, which uses compact substructures to predict function from protein-level data alone >
Marcus: It’s a method that moves us toward reasoning over functional units rather than just residue embeddings, and that's a shift in how we model these systems >
Yuki: This suggests that functional organization in proteins is hierarchical, with these smaller substructures building up to define a larger function across different scales >
More episodes
- 2610.33881-Sensorimotor behavior from an untrained brain-and-nerve-cord connectome
- 2610.40344-Morphological Features of Murine Pulmonary Arterial Networks for Diagnosing Vascular Disease
- Daily Summary for 2026-11-19
- 2609.10193-Are You Learning Biological Signal or Shortcuts? Auditing and Mitigating Bias in Protein-Protein Interaction Datasets
- 2610.38236-Generative discovery of chemical reaction networks
- 2507.11176-An Interpretable AI framework Quantifying Traditional Chinese Medicine Principles Towards Enhancing and Integrating with Modern Biomedicine
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- 2504.03590-Towards a Unified Framework for Determining Conformational Ensembles of Disordered Proteins
- 2603.15217-A multiscale discrete-to-continuum framework for structured population models