FILO: A Unified Fisher-Geometric Framework for Low-Rank Adaptation
cs.LG, cs.AI, cs.CL
Submitted: 2026-05-09
Updated: 2026-11-05
Terminology
Sources
- GPT-4 Technical Report
- LoRA meets Riemannion: Muon Optimizer for Parametrization-independent Low-Rank Adapters
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Mistral 7B
- Adam: A Method for Stochastic Optimization
- DeepSeek-V3 Technical Report
- The E2E Dataset: New Challenges For End-to-End Generation
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
- Qwen2.5 Technical Report
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis