Analysis of Quantized and Efficiently Adapted Protein Language Models
cs.LG, q-bio.QM
Submitted: 2026-09-30
Updated: 2026-09-30
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Scaling Laws for Neural Language Models
- Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
- A Survey of Quantization Methods for Efficient Neural Network Inference
- QLoRA: Efficient Finetuning of Quantized LLMs
- LoRA: Low-Rank Adaptation of Large Language Models
- Exploring Post-Training Quantization of Protein Language Models
- ProLLaMA: A Protein Large Language Model for Multi-Task Protein Language Processing
- Ankh: Optimized Protein Language Model Unlocks General-Purpose Modelling
- Ankh3: Multi-Task Pretraining with Sequence Denoising and Completion Enhances Protein Representations
- TorchDrug: A Powerful and Flexible Machine Learning Platform for Drug Discovery
- Exploring Concept Depth: How Large Language Models Acquire Knowledge and Concept at Different Layers?
- Explaining and Improving Model Behavior with k Nearest Neighbor Representations
- Understanding intermediate layers using linear classifier probes
- Systematic Characterization of LLM Quantization: A Performance, Energy, and Quality Perspective
- Layer-Wise Evolution of Representations in Fine-Tuned Transformers: Insights from Sparse AutoEncoders
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks