BYOD: Build Your Own DLM - Efficient Autoregressive-to-Diffusion Language Model Conversion
cs.CL, cs.LG
Submitted: 2026-10-30
Updated: 2026-10-30
Code: https://github.com/RuurdKuiper/BYOD
Terminology
Sources
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
- Program Synthesis with Large Language Models
- LLaDA2.0: Scaling Up Diffusion Language Models to 100B
- Evaluating Large Language Models Trained on Code
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Training Verifiers to Solve Math Word Problems
- DiffusionGemma Technical Report
- Efficient-DLM: From Autoregressive to Diffusion Language Models, and Beyond in Speed
- Locally Coherent Parallel Decoding in Diffusion Language Models
- OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models
- Tulu 3: Pushing Frontiers in Open Language Model Post-Training
- An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
- Orca-Math: Unlocking the potential of SLMs in Grade School Math
- Large Language Diffusion Models
- Improved Large Language Diffusion Models
- Carbon Emissions and Large Neural Network Training
- Instruction Tuning with GPT-4
- FP8-LM: Training FP8 Large Language Models
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- Simple and Effective Masked Diffusion Language Models
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data
- BALTO: Balanced Token-Level Policy Optimization for Hallucination Mitigation
- Hidden Measurement Error in LLM Pipelines Distorts Annotation, Evaluation, and Benchmarking