Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models
cs.CL, cs.AI, cs.SE
Submitted: 2024-01-01
Updated: 2026-11-13
Code: https://github.com/bigcode-project/astraios
Terminology
Sources
- Scaling Laws for Generative Mixed-Modal Language Models
- SantaCoder: don't reach for the stars!
- PaLM 2 Technical Report
- Qwen Technical Report
- Evaluating Large Language Models Trained on Code
- Scaling Instruction-Finetuned Language Models
- Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models
- KronA: Parameter Efficient Tuning with Kronecker Adapter
- Scaling Laws for Autoregressive Generative Modeling
- Scaling Laws for Transfer
- Training Compute-Optimal Large Language Models
- Large Language Models for Software Engineering: A Systematic Literature Review
- LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models
- Scaling Laws for Neural Language Models
- StarCoder: may the source be with you!
- WizardCoder: Empowering Code Large Language Models with Evol-Instruct
- Inverse Scaling: When Bigger Isn't Better
- OctoPack: Instruction Tuning Code Large Language Models
- Scaling Data-Constrained Language Models
- Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data