Improving LLM Final Representations with Inter-Layer Geometry
cs.CL, cs.LG
Submitted: 2026-03-24
Updated: 2026-11-18
Code: https://github.com/tomulanovski/ILSE
Terminology
Sources
- On the Bottleneck of Graph Neural Networks and its Practical Implications
- Not All Layers of LLMs Are Necessary During Inference
- Adam: A Method for Stochastic Optimization
- Semi-Supervised Classification with Graph Convolutional Networks
- Towards Improved Sentence Representations using Token Graphs
- DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging
- Layer by Layer: Uncovering Hidden Representations in Language Models
- MUDDFormer: Breaking Residual Bottlenecks in Transformers via Multiway Dynamic Dense Connections
- How Powerful are Graph Neural Networks?
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data