Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Other literature type . 2026
License: CC BY SA
Data sources: ZENODO
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Other literature type . 2026
License: CC BY SA
Data sources: ZENODO
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Other literature type . 2026
License: CC BY
Data sources: ZENODO
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Other literature type . 2026
License: CC BY SA
Data sources: ZENODO
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Other literature type . 2026
License: CC BY SA
Data sources: ZENODO
ZENODO
Presentation . 2026
License: CC BY SA
Data sources: Datacite
ZENODO
Presentation . 2026
License: CC BY SA
Data sources: Datacite
ZENODO
Presentation . 2026
License: CC BY SA
Data sources: Datacite
ZENODO
Presentation . 2026
License: CC BY SA
Data sources: Datacite
ZENODO
Presentation . 2026
License: CC BY SA
Data sources: Datacite
ZENODO
Presentation . 2026
License: CC BY
Data sources: Datacite
ZENODO
Presentation . 2026
License: CC BY
Data sources: Datacite
versions View all 8 versions
addClaim

Evaluating the frontiers of Registered Reports infrastructure — Lessons from the Cancer Research UK Funding Partnership

Authors: Hsing, Pen-Yuan; Kafle, Anushka; Munafò, Marcus; Thompson, Jacqueline;

Evaluating the frontiers of Registered Reports infrastructure — Lessons from the Cancer Research UK Funding Partnership

Abstract

Registered Reports (RRs) are an academic article format where submissions are peer reviewed based on methodological rigour before data collection, with successful submissions granted "in-principle acceptance". This means a journal will publish the final article if the authors have conducted their work as described in the RR (and explained any deviations from the plan), regardless of results. In recent years, funders and journals have formed RR funding partnerships (RRFPs), where review processes for funding applications and manuscripts are combined to varying degrees. RRFPs assure funders that funded projects are carried out as planned, are highly likely to be published, and can be done without the additional time and effort of submitting to multiple journals before acceptance. RRFPs could improve the robustness of scientific research by improving methods before data collection, prevent the cherry-picking of results, and reduce the bias towards only publishing "interesting" results. Since 2020, Cancer Research UK (CRUK) has piloted an RRFP involving a consortium of journals—a significant departure from previous one-funder-one-journal models. This consortium model allows funded researchers to choose from multiple participating journals and does not mandate RR submission. Here we report on the first evaluation of this consortium-based RRFP. We conducted qualitative interviews with CRUK RRFP stakeholders including RR experts and advocates, staff at CRUK and other funders, editors at consortium journals, and researchers participating in the RRFP. These interviews identified markers of research quality from diverse perspectives, explored barriers to RR and RRFP adoption, and informed the development of evaluation tools. Our interviews revealed several implementation challenges. For example, researchers often cannot wait for in-principle acceptance before commencing their work, making RRs impractical for many time-bound funded projects. Additionally, despite the intent to streamline review processes, substantial duplication of effort persists between funder and journal reviews. Interviewees identified opportunities for closer coordination and more efficient and devolved review workflows. We will present these findings with recommendations for improving RRFP design and implementation. We also developed two evaluation instruments refined through multiple rounds of expert feedback. First, a rubric allows funders to assess research quality of research presented in publications from funded projects (both RRs and traditional articles), covering methodological rigour, transparency practices, and subjective dimensions such as novelty and importance of findings. Second, a questionnaire captures the qualitative, intangible experience of researchers who have published a complete RR: changes to workflows, pain points in the RR process, and shifts in attitudes toward open science practices more broadly. These tools provide a template for ongoing evaluation efforts by funders and institutions implementing similar schemes. Beyond the evaluation findings, we discuss the scope and limitations of RRs and RRFPs. Not all research can be easily conducted with fully pre-specified methods, and the suitability of RRs varies across research epistemologies and disciplinary contexts. By examining both the promise and limitations of RRs and RRFPs, we aim to inform more nuanced implementation of open research practices that considers methodological rigour with practical feasibility and epistemic diversity.

The open source font Metropolis is embedded in the attached presentation slides, which are saved with Microsoft® PowerPoint® LTSC 2021 (build 16.0.14334.20624) in the OOXML Strict format (file extension .pptx). Users of other presentation software may need to install this font in their system before opening and remixing this presentation. Attributions for third-party material are in the slides or presenter notes. 

Presented at the Future of Open Research Conference 2026 (FOR2026) at the Technical University of Munich Institute of Advanced Studies on 5 May 2026 (14:00-16:10 UTC+2 Session 4: Openness and Scholarly Communication, chair Rena Alcalay): https://opensciencestudies.eu/for-2026-conference/for2026-program/ 

Related Organizations
  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Green
Funded by
Related to Research communities
Cancer Research