Measuring open science with LLMs: co-creating a toolkit for Open Science assessment
How can we measure Open Science practices at scale? This interactive workshop explores how large language models (LLMs) could help identify and monitor Open Science practices across publications, datasets, software, and other research outputs.
AULA 01.27 - Projectruimte Noord 3
Through facilitated discussions and collaborative exercises, participants will contribute ideas on indicators, data sources, and priorities for future toolkit development. The workshop offers a unique opportunity to help shape a practical, community-informed approach to measuring Open Science. The workshop will also help participants understand how LLMs can spot and measure Open Science practices and where they fall short. Participants will leave with a better understanding of the opportunities and limitations of AI for Open Science assessment and the opportunity to contribute to the design of a practical, community-informed toolkit for measuring Open Science practices at scale.
Tangible outputs will include a prioritized list of Open Science practices, proposed indicators and data sources for measuring them, and a set of community recommendations that will inform the future development of the toolkit. The workshop will also facilitate networking and potential collaborations among researchers, research support professionals, librarians, and policymakers interested in Open Science assessment.