HexaBee-4B: Six-Language Translation with Multilingual Answering and Bidirectional Supervision

Name: HexaBee-4B: Six-Language Translation with Multilingual Answering and Bidirectional Supervision
Uploaded: 2026-10-20T14:25:34.564123+00:00
Duration: 573 s
Description: HexaBee-4B adapts Gemma 3 4B IT into a six-language translator via three stages: Wikipedia continued pretraining, joint multilingual answering and answer-text translation, and bidirectional translation specialization. It reaches 73.75 chrF++ across 30 directions, beating its base (57.11) and Gemma 3 12B IT (66.83), though comparisons lack controlled ablations and use synthetic test data.

HexaBee-4B adapts Gemma 3 4B IT into a six-language translator via three stages: Wikipedia continued pretraining, joint multilingual answering and answer-text translation, and bidirectional translation specialization. It reaches 73.75 chrF++ across 30 directions, beating its base (57.11) and Gemma 3 12B IT (66.83), though comparisons lack controlled ablations and use synthetic test data.

Open the full episode