Towards General Continuous Memory for Vision-Language Models
cs.LG, cs.AI
Submitted: 2025-05-23
Updated: 2026-10-31
Code: https://github.com/WenyiWU0111/CoMEM
Terminology
Sources
- LLaMA: Open and Efficient Foundation Language Models
- Language models show human-like content effects on reasoning tasks
- Large Language Models for Mathematical Reasoning: Progresses and Challenges
- A Survey on Large Language Models for Code Generation
- Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?
- Augmenting Language Models with Long-Term Memory
- Qwen2.5-VL Technical Report
- VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documents
- SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inference
- In-context Learning and Induction Heads
- Training Large Language Models to Reason in a Continuous Latent Space
- Perceiver IO: A General Architecture for Structured Inputs & Outputs
- Attention Is All You Need
- What Does BERT Look At? An Analysis of BERT's Attention
- LoRA: Low-Rank Adaptation of Large Language Models
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
- EchoSight: Advancing Visual-Language Models with Wiki Knowledge
- Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question Answering
- RoRA-VLM: Robust Retrieval-Augmented Vision Language Models
- xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis