GeneSpeak-FP: Target and Compound Retrieval from Observed Cell-Level Perturbation Signatures
summary
The gist
The gist The model GeneSpeak-FP demonstrates that cell-level perturbation signatures contain sufficient signal to narrow both a closed vocabulary of annotated targets and a fixed library of known
In short
GeneSpeak-FP is a gene-token Transformer designed to analyze single-cell perturbation signatures from treated cells against a reference cell line. It jointly ranks known annotated genes and compounds from a fixed library. The model successfully retrieves targets and compounds with performance significantly better than random chance, suggesting perturbation signatures hold useful signal for narrowing candidate spaces.
Key concepts
- GeneSpeak-FP
- A gene-token Transformer model that takes a treated cell's perturbation signature as input. It uses a shared representation to simultaneously rank annotated genes and known compounds from a fixed library, aiming to find compatible targets and drugs.
- Cell-Level Perturbation Signatures
- Data derived from single-cell transcriptomics showing how cells respond when treated with chemicals or perturbations. These signatures capture heterogeneous responses that bulk measurements miss, providing a detailed view of cellular reactions.
- Gene Token Encoding
- The input sequence is structured as [CLS], [ORGAN], followed by gene tokens (g1...gL). Each gene token combines a trainable embedding with a projection of its specific perturbation value, allowing the model to understand the context and effect of each gene in the signature.
- Joint Retrieval Heads
- The model has two separate outputs: one head ranks genes from a closed vocabulary of annotated targets, and another head ranks compounds from a fixed molecular bank. These heads work together using a joint loss function to optimize both retrieval tasks simultaneously.
Terminology used across episodes
This episode discusses
- GeneSpeak-FP: Target and Compound Retrieval from Observed Cell-Level Perturbation Signatures · Paper Radio
- ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction
The paper
GeneSpeak-FP: Target and Compound Retrieval from Observed Cell-Level Perturbation Signatures · Read on arXiv
Kseniia Vaniushkina, Jeongmin Lim, Jinyong Park
AIFFEL Research · Modulabs
Single-cell perturbation profiles may help identify known compounds across cellular contexts. We present GeneSpeak-FP, a gene-token Transformer that jointly ranks recorded compounds and their target annotations from a treated cell relative to a cell-line-specific DMSO reference, together with a coarse organ token. On Tahoe-100M, we split 11,673 drug--cell-line groups 90/10 within each compound. No complete group is shared across partitions, although compound and cell-line identities may recur. In a 38,400-query Monte Carlo pass, the correct compound appears first for 12.9% of cells and within the top 10 for 34.3%, among 379 fixed candidates. The model retrieves 40.8% of annotated targets within the top 10 and 54.4% within the top 20, from a vocabulary of 278 genes. Top-10 compound retrieval and target recall are approximately 13 and 11 times their expected values under uniformly random rankings; top-1 compound retrieval is nearly 49 times chance. Top-10 compound retrieval also exceeds the strongest evaluated post-hoc bag-of-genes control by more than nine times. A separate stochastic pass from the same validation pool gives nearly identical aggregate results. These findings support retrospective candidate-space narrowing in held-out drug--cell-line contexts. Because compound identities may recur and target labels are non-exhaustive metadata, they do not establish unseen-compound discovery, causal target identification, or clinical utility.
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: I'm Tom.
Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.
Tom: We're looking at the paper: "GeneSpeak-FP: Target and Compound Retrieval from Observed Cell-Level Perturbation Signatures".
Jane: Here's the gist of the paper. The gist The model GeneSpeak-FP demonstrates that cell-level perturbation signatures contain sufficient signal to narrow both a closed vocabulary of annotated targets and a fixed library of known compounds in Tahoe-100M.
Tom: Transcriptional profiling provides a phenotypic view of how cells respond to chemical perturbations The Connectivity Map established that expression signatures can connect compounds, genes, and disease states Single-cell chemical screens extend this paradigm by exposing heterogeneous responses that are hidden by bulk measurements Tahoe-100M provides a particularly large resource for studying these relationships across a broad cancer cell-line panel.
Jane: Most recent machine learning work on perturbational transcriptomics asks a forward question: how will a cell respond to a specified perturbation We study a complementary inverse problem.
Tom: Given an observed perturbation signature, can a model retrieve compatible annotated targets and the compound that generated the response from a fixed library This task is useful for organizing known perturbations and narrowing a candidate space, but it is inherently ambiguous: distinct compounds can share targets, structures, or downstream transcriptional effects.
Paper summary: Tom: So to summarize this paper, GeneSpeak-FP proposes a new way to answer an inverse question using single-cell perturbation data. It asks: given a measured transcriptional response from a treated cell relative to its DMSO baseline, which annotated targets and which known compounds in our library are the most likely culprits?
Jane: The core thesis is that these cell-level perturbation signatures contain enough information to narrow down both a closed vocabulary of annotated genes and a fixed library of known compounds when looking at the Tahoe-100M dataset <ref:2607.17671#pg1>.
Lu: They achieve this by using a gene-token Transformer architecture. This model encodes the signature into two different retrieval vectors simultaneously: one for targets and one for molecular embeddings, trained together with supervision on both tasks.
Meng: The paper claims that when they evaluate this model on eleven thousand six hundred seventy-three drug–cell-line conditions, it performs well in ranking annotated genes and ranking compounds within their fixed bank <ref:2607.17671#pg2>.
Tom: Specifically, the results show a target Recall@ten near zero point four one and a compound Hit@ten near zero point three four over a set of three hundred seventy-nine compounds, which they say is better than the controls by large margins <ref:2607.17671#pg2,target Recall@10 near 0.41 and>.
Jane: It matters because it provides a framework for organizing existing in vitro perturbation data, allowing researchers to organize what they already have into meaningful candidate spaces rather than just looking at bulk measurements.
Lu: The paper’s contribution is a multi-task Transformer that jointly ranks targets and compounds through target supervision and molecular alignment, which is a symmetric cross-modal contrastive learning approach.
Meng: It's useful because it leverages the existing structure of the Tahoe dataset, but you have to remember that they are only testing retrieval on held-out condition pairs within each compound group.
Tom: So what we learned here is that cell-level perturbation signatures are a strong signal for organizing existing biological knowledge in this context, even if we can't claim it finds entirely new things outside of the scope of what's already annotated.
Conclusion: Jane: Looking at the paper, "GeneSpeak-FP: Target and Compound Retrieval from Observed Cell-Level Perturbation Signatures," the authors are essentially showing how powerful single-cell data can be for organizing known biological knowledge.
Tom: They used a gene-token Transformer to jointly rank targets and compounds, and they showed this approach provides a measurable performance boost over their controls when trying to retrieve candidates from fixed libraries.
Lu: The implication is that we can use perturbation signatures as a structured way to narrow down the search space for known drugs and genes in an experimental setting.
Meng: For us in the AI startup space, it means if we have large datasets like Tahoe-100M, this model can help us quickly triage millions of possibilities down to a manageable set of relevant targets and compounds for further testing <ref:2607.17671#pg1>.
Tom: It’s about making the organization of perturbation data more efficient, not about proving causality or discovering entirely new molecular mechanisms at this stage.
Jane: So in simple terms, GeneSpeak-FP is a tool that helps you organize existing data to find the most likely targets and compounds consistent with an observed cellular response.
Lu: It’s a strong demonstration of how context—the cell line specific reference—can be used to make these retrieval tasks much more precise than they would be otherwise.
Meng: The paper shows that if you have good data, this model can efficiently filter the massive search space down to a few hundred candidates for follow-up analysis.
Tom: Right, so it’s a way to use high-quality single-cell data to structure the existing knowledge base for finding the most relevant known molecules and genes based on perturbation signatures.
More episodes
- 2606.13221-From Uncertain Judgments to Calibrated Rankings: Conformal Elo Estimation for LLM Evaluation
- 2606.23550-Approximating velocity fields with planted point attractors via Neural-ODE for classification purposes
- 2607.02746-CodeJeNN: A simple C++ neural network generator for physics applications
- 2607.07128-Distributed Sparse Interventions in Language Models
- 2607.08595-Federated Deep Learning for Privacy-Preserving Cardiovascular Disease Risk Prediction
- 2208.07395-Reproduction and Replication of an Adversarial Stylometry Experiment
- 2412.12731-SentiQNF: A Novel Approach to Sentiment Analysis Using Quantum Algorithms and Neuro-Fuzzy Systems
- 2507.20858-A survey of diversity quantification in natural language processing: The why, what, where and how
- 2510.01719-What MLLMs Learn about When they Learn about Multimodal Reasoning
- 2601.15809-SteerEval: Inference-time Interventions Strengthen Multilingual Generalization in Neural Summarization Metrics