ArchSpace: Recording, Reviewing, and Referencing LLM Architecture Research
cs.CL, cs.LG
Submitted: 2026-11-12
Updated: 2026-11-13
Code: https://github.com/allenai/olmes
Terminology
Sources
- Deriving Scaling Laws for OpenEuroLLM Models: Learning Rate, Batch Size and Loss
- DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
- The Llama 3 Herd of Models
- Scaling Laws for Neural Language Models
- Predictable Scale: Part I, Step Law -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining
- Muon is Scalable for LLM Training
- MiniMax-01: Scaling Foundation Models with Lightning Attention
- Olmo 3
- GPT-4 Technical Report
- Deriving Hyperparameter Scaling Laws via Modern Optimization Theory
- Skaling: Chinchilla's Exponents Meet Kaplan's Coupling
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data