Sketchpad: certified exact arithmetic with a small vision-language model
cs.LG, cs.CL, cs.LO
Submitted: 2026-11-03
Updated: 2026-11-03
Code: https://github.com/NeoVand/sketchpad
Terminology
Sources
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- Show Your Work: Scratchpads for Intermediate Computation with Language Models
- Investigating the Limitations of Transformers with Simple Arithmetic Tasks
- Exploring Length Generalization in Large Language Models
- Teaching Arithmetic to Small Transformers
- What Algorithms can Transformers Learn? A Study in Length Generalization
- Transformers Can Achieve Length Generalization But Not Robustly
- PAL: Program-aided Language Models
- Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks
- ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving
- ReTool: Reinforcement Learning for Strategic Tool Use in LLMs
- Making Neural Programming Architectures Generalize via Recursion
- Universal computation is intrinsic to language model decoding
- LoRA: Low-Rank Adaptation of Large Language Models
- Gated Delta Networks: Improving Mamba2 with Delta Rule
- Instruction-Following Evaluation for Large Language Models
- On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes
- RL's Razor: Why Online Reinforcement Learning Forgets Less
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Training Verifiers to Solve Math Word Problems
Related papers
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis
- (Mis)generalization of Helpful-Only Fine-tuning