Rethinking One Gene, One Token: Transcriptome-Aware Tokenization for Single-Cell Foundation Models
q-bio.GN
Submitted: 2026-10-21
Updated: 2026-11-09
Terminology
Sources
- DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification
- Attention Is All You Need
- Beyond Gene Reconstruction: Learning Cell Representations through Complementary Transcriptomic Views
- DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genome
Related papers
- SeekRBP: Leveraging Sequence-Structure Integration with Reinforcement Learning for Receptor-Binding Protein Identification
- Genome-Factory: A Library for Tuning, Deploying, and Interpreting Genomic Foundation Models
- AVA: Agentic Variant Adjudication for Automated, Auditable Read-Level Review in Cancer Diagnostic Sequencing
- C3P: Contrastive promoter-protein pretraining yields representations capturing bacterial gene regulation
- Leveraging genomic deep learning models for the prediction of non-coding variant effects
- Adaptive Allele-Haplotype Incidence Indexing for Pangenome Queries: Representation, Reconstruction, and Benchmarking