Norway's 2 petabytes of Huawei flash storage and LLM training
Source: News.Ycombinator
Published:
<p>Norway’s National Library is developing a large language model (LLM) that understands the Norwegian language and is using 2 PB of Huawei OceanStor Dorado flash storage in its AI training data pipeline.</p> <p>Marius Husnes, the Head of IT Platform at the library ( Nasjonlbiblioteket ) discussed t