Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml Jakob Voss, based on art designer at PLoS, modified by Wikipedia users Nina and Beao Closed Access logo, derived from PLoS Open Access logo. This version with transparent background. http://commons.wikimedia.org/wiki/File:Closed_Access_logo_transparent.svg Jakob Voss, based on art designer at PLoS, modified by Wikipedia users Nina and Beao Utrecht University R...arrow_drop_down
image/svg+xml Jakob Voss, based on art designer at PLoS, modified by Wikipedia users Nina and Beao Closed Access logo, derived from PLoS Open Access logo. This version with transparent background. http://commons.wikimedia.org/wiki/File:Closed_Access_logo_transparent.svg Jakob Voss, based on art designer at PLoS, modified by Wikipedia users Nina and Beao
https://doi.org/10.33540/1033...
Doctoral thesis . 2022 . Peer-reviewed
Data sources: Crossref
Pure Utrecht University
Doctoral thesis . 2022
versions View all 3 versions
addClaim

Unraveling programmatic assessment

Issues of validity in high-stakes decision-making
Authors: de Jong, Lubberta Hendrike;

Unraveling programmatic assessment

Abstract

Within health professions programs programmatic assessment has been proposed to optimize the assessment of competency-based education. Programmatic assessment aims to create a coherent system of assessment. By providing meaningful feedback, together with creating follow-up, the learner has the opportunity to learn and improve its performance. Pass/fail decisions (i.e., high-stakes decisions) do not take place after each assessment. Alternatively, every assessment is low-stakes and only after a longer period of time a high-stakes decision is made. In this thesis we have tried to unravel programmatic assessment by investigating whether validity evidence can be provided for high-stakes decision-making. Can we justify the high-stakes decision about the learner’s progression and performance within a programmatic approach to assessment? To investigate whether it is possible to generate sufficient and reliable information about the learner as input for the high-stakes decision, we performed a quantitative analysis of the scores provided by raters over time. Furthermore, not only the raters are essential in creating the information to inform the high-stakes decision, learners are involved as well by seeking feedback. To learn more about this, we investigated learner’s motivation toward feedback-seeking. Next to that, the concept of saturation of information is important. We did an initial exploration of the concept of saturation of information by investigating the relationship between the number of datapoints and the inter-rater agreement of the examiners involved in high-stakes decision-making. Then, we dived deeper into the concept by investigating the content of the datapoints, i.e., the quality of narrative information. In the final part of this thesis we investigated whether, and if so, what differences exist in designing a high-stakes decision-making procedure between programs within health professions education. As a follow-up on this, in a commentary we proposed an idea to take a different view on the role of the committee consisting of examiners performing the high-stakes decision. As the final chapter, we discussed the results of the studies performed in this thesis within existing literature and propose suggestions for further research.

Country
Netherlands
Related Organizations
Keywords

beslisfunctie, programmatisch toetsen, validiteit, validity, programmatic assessment, high-stakes decision, competency-based education, competentiegericht onderwijs

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Upload OA version
Are you the author of this publication? Upload your Open Access version to Zenodo!
It’s fast and easy, just two clicks!