RAGenome: Scaling Retrieval-Based Genomic Language Models to Long Contexts
RAGenome is a new retrieval-based genomic language model that scales pretraining to much longer contexts (100 times longer than existing models) by efficiently using whole-genome alignments. It improves gene finding performance significantly while maintaining strong performance on variant effect prediction, unifying evolutionary modeling and long-range genomic understanding.