SGA-Sparse: Training Native SwiGLU Gates for Activation-Sparse and Low-Bit LLMs

arXiv:2611.11223 · cs.LG, cs.AI, cs.CL · Submitted 2026-11-08 · Read on arXiv

cs.LG, cs.AI, cs.CL

Submitted: 2026-11-08

Updated: 2026-11-08

Terminology

Sources

Related papers