UniBERT: Adversarial Training for Language-Universal Representations
cs.CL
Submitted: 2025-03-16
Updated: 2025-09-01
Terminology
Sources
- RoBERTa: A Robustly Optimized BERT Pretraining Approach
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
- A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias
- Distilling the Knowledge in a Neural Network
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data