A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model
This work assesses the total carbon footprint of Noor, an Arabic language model project, across its entire lifecycle from data collection to future use. The study found that pretraining compute drives over half of emissions, but R&D and storage also contribute significantly. Recommendations focus on efficient architectures like MoE and quantization to reduce energy use.