Norway Deploys Massive 2-Petabyte Huawei Flash Storage for AI Model Training
training
| Source: HN | Original article
Norway's National Library develops large language model using 2PB of Huawei storage.
Norway's National Library is developing a large language model (LLM) that understands the Norwegian language, utilizing 2 petabytes of Huawei OceanStor Dorado flash storage in its AI training data pipeline. This project aims to create a sovereign LLM, specifically designed to comprehend Norwegian culture and history. The library's Head of IT Platform, Marius Husnes, emphasized the necessity of this project, highlighting the importance of preserving and promoting Norway's cultural heritage through AI technology.
This development matters as it showcases Norway's efforts to establish a strong foundation in AI, particularly in the realm of language models. By creating a sovereign LLM, Norway can maintain control over its data and ensure that its cultural identity is preserved and respected. The use of Huawei's flash storage solutions also underscores the critical role of high-performance storage in supporting complex AI workloads.
As this project progresses, it will be interesting to watch how Norway's sovereign LLM evolves and how it compares to other language models. Additionally, the library's approach to sharing its training data and collaborating with other model builders may set a precedent for future AI development in the region. With the Norwegian National Library at the forefront of this initiative, the country is poised to make significant strides in AI innovation and cultural preservation.
Sources
Back to AIPULSEN