ShiftRAG: Bypassing the Textual Bottleneck via Decoupled Learning and Continuous Soft Tokens
cs.CL, cs.AI
Submitted: 2026-10-31
Updated: 2026-10-31
Code: https://github.com/meaningful96/ShiftRAG
Terminology
Sources
- Training Verifiers to Solve Math Word Problems
- Gemma 2: Improving Open Language Models at a Practical Size
- The Llama 3 Herd of Models
- Mistral 7B
- Representation Learning with Contrastive Predictive Coding
- Qwen2.5 Technical Report
- OpenAI GPT-5 System Card
- Measuring short-form factuality in large language models
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data