MIXAR: Scaling Autoregressive Pixel-based Language Models to Multiple Languages and Scripts
MIXAR is a new generative, multilingual pixel-based language model that uses rendered text as input instead of traditional tokens. It was trained on eight languages and multiple scripts, scaling up to 0.5B parameters. This model shows better performance than previous pixel models in both generation and understanding tasks, proving that visual text representation can handle diverse languages effectively.