Throughout the morning, researchers and practitioners from across Norway will present talks on benchmarking from different perspectives, including statistical approaches, applications in health care, and the challenges of distributional shift. The program also features a keynote on safe and secure AI, as well as a tutorial session that will give participants the chance to work hands-on with benchmarking methods.
The event is open to students, researchers and professionals who work with or are simply curious about AI evaluation. We look forward to seeing you in September, and you can register already now.
Program:
| Time | Title | Presenter |
|---|---|---|
| 08:00 - 08:05 | Introduction | Andrea Gasparini, NORA.ai |
| 08:05 - 08:45 | Benchmarking: The key to safe and secure AI | Michael Riegler, Simula |
| 08:45 - 08:55 | Coffee break | |
| 08:55 - 09:35 | Benchmarking LLMs for Norwegian | Vladislav Mikhailov, LTG, UiO |
| 09:35 - 09:55 | AI benchmarking from a statisticians perspective | Hugo Lewi Hammer, OsloMet |
| 09:55 - 10:15 | AI benchmarking in practice in the Norwegian health care system | Hilde Lovett, Helsedir |
| 10:15 - 10:35 | The limits of bench-marking in the context of distributional shift | Birk Torpmann-Hagen, UiT |
| 10:35 - 10:45 | Coffee break | |
| 10:45 - 11:30 | Evaluating AI with AI: LLMs in Benchmarking Pipelines (Tutorial) | Sushant Gautam, SimulaMet |
If you have any questions or need further information, feel free to reach out to us at kushtrim.visoka@nora.ai.
 | This event is funded by the European Union's DIGITAL EUROPE Programme, under Grant Agreement No. 101083966, Nemonoor. |
|---|