Saidzoda-Tajik-LFM-2.6B: Adapting a 2.6B Hybrid Model to Tajik Tool Calling, and What Continued Pretraining Takes Away
cs.CL
Submitted: 2026-10-30
Updated: 2026-10-30
Terminology
Sources
- LFM2 Technical Report
- Benchmarking Parameter-Efficient Fine-Tuning of Large Language Models for Low-Resource Tajik Text Generation with the Tajik Web Corpus
- Large Language Models for Low-Resource Languages: A Conceptual Framework for an Electronic Explanatory Dictionary of the Tajik Language
- TajikNLP: An Open-Source Toolkit for Comprehensive Text Processing of Tajik (Cyrillic Script)
- LoRA Learns Less and Forgets Less
- An Expanded Massive Multilingual Dataset for High-Performance Language Technologies (HPLT)
- When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages
- Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca
- Teaching a Language Model to Speak the Language of Tools
- TinyAgent: Function Calling at the Edge
- Continual Pre-Training of Large Language Models: How to (re)warm your model?
- LoRA: Low-Rank Adaptation of Large Language Models
- BenchMAX: A Comprehensive Multilingual Evaluation Suite for Large Language Models
- Simple and Scalable Strategies to Continually Pre-train Large Language Models
- A Rank Stabilization Scaling Factor for Fine-Tuning with LoRA
- Overcoming catastrophic forgetting in neural networks
- MADLAD-400: A Multilingual And Document-Level Large Audited Dataset
- Soro: A Lightweight Foundation Model and Chatbot for Tajik
- Hammer: Robust Function-Calling for On-Device Language Models via Function Masking
- ToolACE: Winning the Points of LLM Function Calling
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data
- BALTO: Balanced Token-Level Policy Optimization for Hallucination Mitigation
- Hidden Measurement Error in LLM Pipelines Distorts Annotation, Evaluation, and Benchmarking