Guided Star-Shaped Masked Diffusion
cs.LG
Submitted: 2025-10-09
Updated: 2026-11-06
Project page: http://skylion007.github.io/OpenWebTextCorpus
Terminology
Sources
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
- Program Synthesis with Large Language Models
- Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design
- Evaluating Large Language Models Trained on Code
- Training Verifiers to Solve Math Word Problems
- TinyStories: How Small Can Language Models Be and Still Speak Coherent English?
- Self Speculative Decoding for Diffusion Large Language Models
- DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generation
- Edit Flows: Flow Matching with Edit Operations
- Measuring Massive Multitask Language Understanding
- Don't Settle Too Early: Self-Reflective Remasking for Diffusion Language Models
- Qwen2.5-Coder Technical Report
- Accelerating Diffusion LLMs via Adaptive Parallel Decoding
- Fine-Tuning Masked Diffusion for Provable Self-Correction
- The Stack: 3 TB of permissively licensed source code
- Tulu 3: Pushing Frontiers in Open Language Model Post-Training
- Think While You Generate: Discrete Diffusion with Planned Denoising
- Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps
- Cosmos: Compressed and Smooth Latent Space for Text Diffusion Modeling
- Large Language Diffusion Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis