NB-REAL Workshop 2025

Nordic-Baltic Responsible Evaluation and Alignment of Language Models

About the Workshop

This workshop focuses on the responsible evaluation and alignment of Large Language Models (LLMs) for Nordic and Baltic languages.

For this workshop, Nordic countries include Åland Islands, Denmark, Faroe Islands, Finland, Greenland, Iceland, Norway and Sweden. Baltic countries include Estonia, Latvia, and Lithuania.

Workshop Organizers

Hafsteinn Einarsson

Hafsteinn Einarsson

Associate Professor in Computer Science, University of Iceland

hafsteinne@hi.is

Annika Simonsen

Annika Simonsen

PhD Student, University of Iceland

annika@hi.is

Dan Saattrup Nielsen

Dan Saattrup Nielsen

Senior AI Specialist, Alexandra Institute

dan.nielsen@alexandra.dk

Program Committee

Barbara Scalvini

University of the Faroe Islands

Garðar Ingvarsson

Miðeind

Iris Edda Nowenstein

University of Iceland

Kenneth Enevoldsen

Aarhus University

Lars Bungum

Norwegian University of Science and Technology

Mathias Stenlund

University of Iceland

Peter Ebert Christensen

University of Copenhagen

Steinunn Rut Friðriksdóttir

University of Iceland

Program Design

Half-day workshop on March 2, 2025 (pre-conference). Only on-site participation available.

Time Activity
09:00-09:15 Opening Remarks
09:15-10:00 Keynote Speaker (45 min): Annika & Dan
Title TBA
10:00-10:30 Coffee Break
10:30-10:50 Paper Presentation 1 (20 min):
DaKultur: Evaluating the Cultural Awareness of Language Models for Danish with Native Speakers
Max Müller-Eberstein, Mike Zhang, Elisa Bassignana, Peter Brunsgaard Trolle, Rob van der Goot
10:50-11:10 Paper Presentation 2 (20 min):
What's Wrong With This Translation? Simplifying Error Annotation For Crowd Evaluation
Iben Nyholm Debess, Alina Karakanta, Barbara Scalvini
11:10-11:30 Paper Presentation 3 (20 min):
The Danish Idiom Dataset: A collection of 1000 Danish idioms and fixed expressions
Nathalie Hau Sørensen, Sanni Nimb
11:30-11:40 Closing Remarks and Future Directions (10 min)
11:40-13:00
Poster Presentations:
  • Towards Multilingual LLM Evaluation for Baltic and Nordic languages: A study on Lithuanian History
    Yevhen Kostiuk, Oxana Vitman, Łukasz Gągała, Artur Kiulian
  • The Veln(ia)s is in the Details: Evaluating LLM Judgment on Latvian and Lithuanian Short Answer Matching
    Yevhen Kostiuk, Oxana Vitman, Łukasz Gągała, Artur Kiulian
  • Image-Text Relation Prediction for Multilingual Tweets
    Matīss Rikters, Edison Marrese-Taylor
13:00 Lunch

Call for Papers

We invite submissions on topics including, but not limited to:

Submissions can be long papers (8 pages) or short papers (4 pages) in the ACL format. All submissions will undergo peer review by the program committee.

Paper Submissions

Submissions are now closed

Thank you for your interest. The submission deadline has passed.

Important Dates

Expected Outcomes and Impact

The NB-REAL workshop aims to:

By addressing the unique challenges and opportunities in responsible LLM evaluation and alignment for Nordic and Baltic languages, NB-REAL will foster collaboration and advance the field in ways that benefit both the regional and global NLP communities.