Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Other literature type . 2025
License: CC BY SA
Data sources: ZENODO
ZENODO
Other literature type . 2025
License: CC BY SA
Data sources: Datacite
ZENODO
Other literature type . 2025
License: CC BY SA
Data sources: Datacite
versions View all 2 versions
addClaim

A whitepaper on reforming research assessment for a digital and AI-driven science future

Authors: Kirbas, Zeynep Sare; Arpaci, Selin; Ekmekci, Perihan Elif; Crawley, Francis P.; Karaman, Beril Berfin; De Sousa Freitas, Mara Cristina; Stoka, Veronika; +2 Authors

A whitepaper on reforming research assessment for a digital and AI-driven science future

Abstract

This whitepaper presents a strategic framework for advancing Responsible Research Assessment (RRA) across the European digital research ecosystem. Responding to the European Commission’s call for a science system fit for the AI era, we propose a common roadmap to transition from outdated, publication-centric evaluation towards inclusive, transparent, and context-sensitive practices. Our initiative is built upon a foundation of core ethical principles, translated into actionable tools through a coordinated, systemic approach with three key pillars: (1) participatory design with Research and Innovation Actors (RIA), (2) flexibility and adaptability to diverse disciplines and missions, and (3) interoperability within the wider open science ecosystem. We introduce two key innovations developed through extensive co-design: the Ethics Assessment Alignment Matrix (EAAM), which bridges normative values with assessable research domains, and the Modular Assessment Configurator (MAC), a digital tool that enables institutions and funders to create configurable, explicable, and value-aligned assessment workflows. These tools are designed to integrate with open infrastructures, notably the OpenAIRE Graph, which provides a provenance-enriched, FAIR-aligned evidence base for assessments. By fusing ethical foresight with operational, machine-actionable solutions, this work provides a practical pathway to embed open science principles directly into research and career evaluation. It demonstrates how aligning policy, ethics, and technical infrastructure is essential for building a trustworthy, resilient, and innovative research assessment system for the future.

This whitepaper proposes a strategic framework to advance Responsible Research Assessment (RRA) in Europe, responding to the need for a science system fit for the AI era. The initiative is rooted in the ethical principles developed by the CoARA Ethics and Research Integrity Policy for Responsible Research Assessment in Data and Artificial Intelligence (ERIP) Working Group. We introduce two co-designed tools, the Ethics Assessment Alignment Matrix (EAAM) and the Modular Assessment Configurator (MAC), to enable value-aligned, customizable evaluation workflows that integrate with open infrastructures like the OpenAIRE Graph. By fusing ethical principles with operational solutions, this initiative provides a practical pathway to embed open science directly into research and career evaluation.

Keywords

open access, AI, research infrastructure, open science, ethical research, open infrastructures, Ethics Assessment Alignment Matrix (EAAM), CoARA-ERIP, CoARA, artificial intelligence, research assessment, Modular Assessment Configurator (MAC), ERIP

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Related to Research communities
OpenAIRE