Danish Foundation Models: Danish Foundation Models

TY - UNPB

T1 - Danish Foundation Models

T2 - Danish Foundation Models

AU - Enevoldsen, Kenneth

AU - Hansen, Lasse

AU - Nielsen, Dan Satrap

AU - Egebæk, Rasmus

AU - Holm, Søren

AU - Nielsen, Martin C.

AU - Bernstorff, Martin

AU - Larsen, Rasmus

AU - Jørgensen, Peter B.

AU - Højmark-Bertelsen, Malte

AU - Vahlstrup, Peter Bjerregaard

AU - Møldrup-Dalum, Per

AU - Nielbo, Kristoffer Laigaard

PY - 2023/11/12

Y1 - 2023/11/12

N2 - Large language models, sometimes referred to as foundation models, have transformed multiple fields of research. However, smaller languages risk falling behind due to high training costs and small incentives for large companies to train these models. To combat this, the Danish Foundation Models project seeks to provide and maintain open, well-documented, and high-quality foundation models for the Danish language. This is achieved through broad cooperation with public and private institutions, to ensure high data quality and applicability of the trained models. We present the motivation of the project, the current status, and future perspectives.

AB - Large language models, sometimes referred to as foundation models, have transformed multiple fields of research. However, smaller languages risk falling behind due to high training costs and small incentives for large companies to train these models. To combat this, the Danish Foundation Models project seeks to provide and maintain open, well-documented, and high-quality foundation models for the Danish language. This is achieved through broad cooperation with public and private institutions, to ensure high data quality and applicability of the trained models. We present the motivation of the project, the current status, and future perspectives.

KW - Danish Language Processing

KW - natural language processing

KW - Danish

KW - Low-resource NLP

M3 - Preprint

BT - Danish Foundation Models

PB - ArXiv

ER -