Genome-Factory: A Library for Tuning, Deploying, and Interpreting Genomic Foundation Models
summary
The gist
GENOME-FACTORY introduces GENOME-FACTORY, the first integrated Python library for tuning, deploying, and interpreting genomic foundation models This framework simplifies and unifies the workflow for…
In short
GENOME-FACTORY is an integrated Python library for tuning, deploying, and interpreting genomic foundation models. It unifies the entire workflow—from data collection and model training to inference and biological interpretation—using six modular components. The framework enables efficient fine-tuning methods like LoRA while providing tools to link model internal representations directly to biological features.
Key concepts
- Genome Collector
- This component retrieves genomic sequences from public repositories. It performs necessary preprocessing steps, such as normalizing GC content and correcting 'N' nucleotides, ensuring the input data is clean and ready for model training.
- Model Trainer
- This module allows users to fine-tune various foundation models using different strategies. It supports full parameter fine-tuning as well as parameter-efficient methods like LoRA or adapter tuning, which significantly reduces computational needs and memory usage.
- Biological Interpreter
- This feature enhances model understanding by using a sparse autoencoder. It maps the complex internal model embeddings to specific, biologically meaningful latent dimensions, allowing researchers to see which parts of the model relate to known genomic features.
- Benchmarker
- The Benchmarker module is used for rigorous evaluation. It provides two built-in open-source genomic benchmarks and allows users to add custom tasks via a plugin system, enabling standardized comparison of different models and tuning strategies.
Terminology used across episodes
This episode discusses
- Genome-Factory: A Library for Tuning, Deploying, and Interpreting Genomic Foundation Models · Paper Radio
- Gradio: Hassle-Free Sharing and Testing of ML Models in the Wild
- GPT-4 Technical Report
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Liger Kernel: Efficient Triton Kernels for LLM Training
- An Introduction to Convolutional Neural Networks
- NeurIPS 2023 LLM Efficiency Fine-tuning Competition
- Discrete Flow Matching Policy Optimization
- HuggingFace's Transformers: State-of-the-art Natural Language Processing
- Sci2Pol: Evaluating and Fine-tuning LLMs on Scientific-to-Policy Brief Generation
The paper
Genome-Factory: A Library for Tuning, Deploying, and Interpreting Genomic Foundation Models · Read on arXiv
Center for Foundation Models and Generative AI at Northwestern University · School of Natural Sciences at University of California at Merced, USA · Department of Energy Joint Genome Institute, Lawrence Berkeley National Laboratory, USA · Environmental Genomics and Systems Biology Division at Lawrence Berkeley National Laboratory, USA · Department of Statistics and Data Science at Northwestern University
We introduce Genome-Factory, the first integrated Python library for tuning, deploying, and interpreting genomic foundation models. Our core contribution is to simplify and unify the workflow for genomic model development: data collection, model tuning, inference, benchmarking, and interpretability. For data collection, Genome-Factory offers an automated pipeline to download genomic sequences and preprocess them. For model tuning, Genome-Factory supports both full and parameter-efficient fine-tuning across diverse genomic models. For inference, Genome-Factory enables both embedding extraction and DNA sequence generation. For benchmarking, we include two existing benchmarks and provide a flexible interface to incorporate additional benchmarks. For interpretability, Genome-Factory introduces an open-source biological interpreter based on a sparse auto-encoder. We validate the utility of Genome-Factory across three dimensions: (i) Compatibility with diverse models and fine-tuning methods; (ii) Benchmarking downstream performance using two open-source benchmarks; (iii) Biological interpretation of learned representations with DNABERT-2. These results highlight its practical value for real-world genomic analysis. GitHub: https://github.com/WeiminWu2000/Genome Factory.
Transcript
Introduction to the show: ident: Genomics Radio. Generated commentary on the latest computational biology and genomics papers.
Ines: I'm Ines.
Marcus: And I'm Marcus, here with Yuki.
Ines: We're looking at the paper: "Genome-Factory: A Library for Tuning, Deploying, and Interpreting Genomic Foundation Models".
Marcus: Here's the gist of the paper. GENOME-FACTORY introduces GENOME-FACTORY, the first integrated Python library for tuning, deploying, and interpreting genomic foundation models This framework simplifies and unifies the workflow for genomic model development: data collection, model tuning, inference, benchmarking, and interpretability Framework Components GENOME-FACTORY features six modular components to unify the workflow for genomic models The components include (i) Genome Collector which retrieves genomic sequences from public repositories and applies preprocessing such as GC content normalization and N nucleotide correction, (ii) Model Loader which supports diverse GFMs including HyenaDNA, DNABERT-2, Caduceus, Nucleotide Transformer, EVO and GenomeOcean as well as their tokenizers, (iii) Model Trainer which enables full-parameter fine-tuning and parameter-efficient methods such as low-rank adaptation (LoRA) and adapter tuning for both classification and regression tasks, (iv) Inference Engine which facilitates both embedding extraction and DNA sequence generation, (v) Benchmarker which provides two built-in, open-source genomic benchmarks and a plugin system for incorporating custom, domain-specific evaluation tasks, and (vi) Biological Interpreter which enhances model interpretability through a sparse autoencoder.
Ines: Fine-Tuning Efficiency The experiments demonstrate the utility of GENOME-FACTORY across three dimensions, including compatibility with diverse models and fine-tuning methods The adapter-based method consistently shows the highest efficiency in terms of trainable parameters, consuming less memory and achieving higher throughput compared to full fine-tuning for most models.
Marcus: For instance, the DNABERT-2 adapter uses only 0.2 million trainable parameters and reaches a throughput of 124,000 tokens per second.
Ines: LoRA tuning also offers strong efficiency gains as model size grows, reducing the parameter ratio and increasing memory savings for models like Nucleotide Transformer.
Title and authors: Ines: Let’s talk about the title again, "Genome-Factory: A Library for Tuning, Deploying, and Interpreting Genomic Foundation Models." It’s very descriptive of what they’re trying to achieve with this library.
Marcus: I think the authors are setting out to solve a real problem in the field. They point out that existing language model fine-tuning frameworks don't focus on biological interpretability, which is where scientists need it most for genomics.
Yuki: It’s interesting how they framed this as a unified platform because it addresses the fragmented nature of genomic AI development right now.
Ines: They are providing a way to streamline that entire lifecycle—from data collection and preprocessing to inference and finally interpretation—all in one place. It simplifies the workflow significantly, according to their abstract.
Marcus: It’s about reducing the technical barrier for researchers who aren't deep machine learning experts but still need access to these large genomic models. They emphasize making it user-friendly with a zero-code command line interface and a web based user interface.
Yuki: That accessibility is important because if you can’t easily run these complex tools, the potential impact on personalized medicine or evolutionary biology gets stuck in research labs.
Ines: And they are showing that this unification helps across three dimensions they validated: compatibility with diverse models, efficiency of fine-tuning methods, and the utility of the biological interpretation aspect.
Marcus: They’re trying to show that this isn't just a neat piece of software; it’s a framework that actually works across different genomic model types and tuning strategies.
The paper's summary: Ines: To summarize what the paper actually proposes, they are introducing GENOME-FACTORY as the first integrated Python library designed to tune, deploy, and interpret these genomic foundation models. It simplifies the entire development pipeline for genomic models.
Marcus: The core contribution is unifying data collection, model tuning—which can be full fine-tuning or parameter efficient methods—inference for both embeddings and sequence generation, benchmarking against existing tasks, and biological interpretation via a sparse autoencoder.
Yuki: It’s about providing that whole pipeline in one place. I imagine that makes it much easier to reproduce experiments because you don't have to stitch together dozens of different scripts from various repositories.
Ines: That’s what they are aiming for, making the process reproducible by standardizing the steps for every stage of model development. They also focus on how to handle diverse models like HyenaDNA or DNABERT-two through a single loader component <ref:2509.12266#pg1>.
Marcus: They are explicitly addressing the gap in current frameworks where biological interpretability isn't a main focus, and they are solving that by adding the sparse autoencoder workflow for interpretation.
Yuki: That’s a big step because it shifts the focus from just getting high accuracy scores to actually understanding what those models are learning about our biology.
The paper's improvements: Ines: The paper highlights some specific improvements they’ve built into this library, focusing heavily on how efficiently you can fine tune these models. They show that adapter-based methods, like LoRA and adapters, are often more efficient than full fine-tuning for most models.
Marcus: They give concrete numbers here. For example, they show the DNABERT-two adapter uses only zero point two million trainable parameters and hits a throughput of one hundred twenty-four thousand tokens per second. That’s a big efficiency gain over full fine-tuning.
Yuki: The fact that LoRA tuning also shows strong gains as model size increases, reducing the parameter ratio for models like Nucleotide Transformer, suggests this is a flexible approach that scales well with larger architectures.
Ines: Beyond just efficiency, they’ve added task-specific dataset builders within the Genome Collector. This means you can automatically generate data for specific genomic tasks like promoter region classification or enhancer region datasets.
Marcus: And that’s useful because it cuts down on a huge manual effort in preparing data for downstream tasks. It automates the creation of task-ready datasets, which is a big practical improvement for researchers.
Yuki: So, they are making the input side much more automated, which feeds into the training side and ultimately makes it easier to get results across different biological questions.
Conclusion: Ines: So wrapping this up, GENOME-FACTORY is presented as a unified infrastructure for tuning and deploying genomic foundation models by offering six modular components that handle everything from data collection to interpretation. It’s designed to lower the technical hurdle for using these models in research.
Marcus: The main implication is that we can get researchers using diverse genomic models, like DNABERT-two or GenomeOcean, much faster and more efficiently through parameter efficient methods like LoRA tuning <ref:2509.12266#pg1>.
Yuki: For me, it means we have a better tool to move beyond just prediction and actually start asking meaningful biological questions about the underlying sequence features because of that sparse autoencoder interpretation.
Ines: Exactly what I mean. It bridges the gap between complex machine learning architectures and practical biological discovery by making it easier to link model internals to measurable genomic properties.
Marcus: Overall, this paper provides a solid open-source infrastructure that supports broader benchmark coverage through built in tools and plugin systems, which is good for comparing different tuning strategies.
Yuki: It lays a foundation for more reproducible and responsible scientific innovation in this area by providing these standardized tools for the entire genomic model lifecycle.
More episodes
- 2610.33881-Sensorimotor behavior from an untrained brain-and-nerve-cord connectome
- 2610.40344-Morphological Features of Murine Pulmonary Arterial Networks for Diagnosing Vascular Disease
- Daily Summary for 2026-11-19
- 2609.10193-Are You Learning Biological Signal or Shortcuts? Auditing and Mitigating Bias in Protein-Protein Interaction Datasets
- 2610.38236-Generative discovery of chemical reaction networks
- 2507.11176-An Interpretable AI framework Quantifying Traditional Chinese Medicine Principles Towards Enhancing and Integrating with Modern Biomedicine
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- 2504.03590-Towards a Unified Framework for Determining Conformational Ensembles of Disordered Proteins
- 2603.15217-A multiscale discrete-to-continuum framework for structured population models