DunbaaBERT: From Sacrifice to Semantics
cs.CL
Submitted: 2026-05-26
Updated: 2026-11-06
Code: https://github.com/attardi/wikiextractor
Terminology
Sources
- GPT-4 Technical Report
- UrBLiMP: A Benchmark for Evaluating the Linguistic Competence of Large Language Models in Urdu
- Overview of Abusive and Threatening Language Detection in Urdu at FIRE 2021
- Generalists vs. Specialists: Evaluating Large Language Models for Urdu
- Longformer: The Long-Document Transformer
- Systematic Inequalities in Language Technology Performance across the World's Languages
- EuroBERT: Scaling Multilingual Encoders for European Languages
- Enriching Word Vectors with Subword Information
- Beyond English-Centric Multilingual Machine Translation
- Document-Level Sentiment Analysis of Urdu Text Using Deep Learning Techniques
- RUBERT: A Bilingual Roman Urdu BERT Using Cross Lingual Transfer Learning
- RoBERTa: A Robustly Optimized BERT Pretraining Approach
- mmBERT: A Modern Multilingual Encoder with Annealed Language Learning
- CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages
- CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB
- Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
- Nystr\"omformer: A Nystr\"om-Based Algorithm for Approximating Self-Attention
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data