IOR-mandagsnytt 18.november 2019

• Mikhailov, Vladislav; Enstad, Tita Ranveig; Samuel, David; Farseth?s, Hans Christian; Velldal, Erik & ?vrelid, Lilja [Vis alle 7 forfattere av denne artikkelen] (2025). NorEval: A Norwegian Language Understanding and Generation Evaluation Benchmark. I Che, Wanxiang; Nabende, Joyce; Shutova, Ekaterina & Pilehvar, Mohammad (Red.), Findings of the Association for Computational Linguistics: ACL 2025. Association for Computational Linguistics. ISSN 979-8-89176-256-5. s. 3495¨C3541. doi: 10.18653/v1/2025.findings-acl.181. Vis sammendrag

  This paper introduces NorEval, a new and comprehensive evaluation suite for large-scale standardized benchmarking of Norwegian generative language models (LMs). NorEval consists of 24 high-quality human-created datasets ¨C of which five are created from scratch. In contrast to existing benchmarks for Norwegian, NorEval covers a broad spectrum of task categories targeting Norwegian language understanding and generation, establishes human baselines, and focuses on both of the official written standards of the Norwegian language: Bokm?l and Nynorsk. All our datasets and a collection of over 100 human-created prompts are integrated into LM Evaluation Harness, ensuring flexible and reproducible evaluation. We describe the NorEval design and present the results of benchmarking 19 open-source pretrained and instruction-tuned LMs for Norwegian in various scenarios. Our benchmark, evaluation framework, and annotation materials are publicly available.

• Riisn?s, Rolf; Mahler, Tobias; Gj?steen, Kristian; Langford, Malcolm; W?rstad, Tone Linn & Omland, Lars Petter Halvorsen [Vis alle 7 forfattere av denne artikkelen] (2025). N?r BankID er nede, stopper Norge . Dagensn?ringsliv.
• Sunde, J?rn ?yrehagen (2025). Moses, Jesus og Hilde Sandvik. V?rt land. ISSN 0805-5424.

Se alle arbeider i Cristin