The Llama 3 Herd of Models
Llama 3 is a foundation model designed for multilinguality, coding, and reasoning. It was developed using massive pre-training on diverse data and refined through Supervised Finetuning (SFT) and Direct Preference Optimization (DPO). The resulting model shows competitive performance across various benchmarks, especially in code and video understanding.