Geometric and algebraic inference in humans and neural networks
q-bio.NC, cs.AI, cs.CL, cs.LG
Submitted: 2026-10-30
Updated: 2026-10-30
Code: https://github.com/jlrussin/geometric-algebraic-ti-transformers
Terminology
Sources
- Phi-4-reasoning Technical Report
- Understanding intermediate layers using linear classifier probes
- Transformers generalize differently from information stored in context vs in weights
- Relational reasoning and inductive bias in transformers and large language models
- Gemma 2: Improving Open Language Models at a Practical Size
- The Llama 3 Herd of Models
- Signatures of human-like processing in Transformer forward passes
- Conflict and Congruency Effects in Large Language Models: In-Weight and In-Context Competition in a Verbal Conflict Task
- Mistral 7B
- Adam: A Method for Stochastic Optimization
- An evolutionary perspective on modes of learning in Transformers
- On the generalization of language models from in-context learning and finetuning: a controlled study
- Show Your Work: Scratchpads for Intermediate Computation with Language Models
- In-context Learning and Induction Heads
- OpenAI o1 System Card
- gpt-oss-120b & gpt-oss-20b Model Card
- Qwen2.5 Technical Report
- From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks
- Emergent Ordinal Geometry in Transformers Trained on Local Comparisons
- Cognitive Convergence: Deep Similarities Between Large Language Models and Human Cognition
Related papers
- Self-Supervised Learning of Local Predictive Directions as a Neural Computation
- Synchronized Hearts, Desynchronized Brains: A Nonlinear Dynamics Perspective for Function and Failure
- Message interaction dynamics covary with brain volume across mammalian connectomes
- Planning as Dynamics Relaxation: Hippocampal Recurrent Network Realizes Optimal Goal-Directed Navigation
- The Platonic brain bridge hypothesis: brain networks as architectural priors for multimodal large language models
- BrainPFN: Amortized Brain-Behaviour Prediction via Prior-Data Fitted Networks