Powered by OpenAIRE graph
Found an issue? Give us feedback
addClaim

Test-taking engagement in low-stakes context

An educational data science approach
Authors: Róbert Csányi;

Test-taking engagement in low-stakes context

Abstract

The research conducted within this dissertation aims to explore and comparatively investigate real-world behavioral outcomes of test-taking engagement in an interactive test environment through self-report and analysis of log and process data. This dissertation brings together three empirical studies on this issue. The instrument used in this research consisted of 10 problems of different complexity requiring interaction to solve, which were suitable for measuring the exploration strategies of different problems. The problems, based on the MicroDYN model, were administered to first-year university students in a low-stakes testing context using the eDia online assessment platform. The exploration of the problems and the interactions used to solve them were recorded in log and process data format, and the effectiveness of different exploration and learning strategies and their impact on problem-solving performance were examined by analyzing these behavioral log data. In addition to self-report questions embedded in different parts of the test, test-taking effort was monitored by the time spent exploring and solving problems and the number of interactions. In the research presented in the first paper, we measured students' test-taking effort using different methods and determined the optimal procedure to diagnose test-taking effort. The results suggest that the number of clicks plays an important role in predicting performance in interactive problem-solving tasks. The responses to the self-report questionnaire did not fully reflect the actual test-taking behavior of the participants. A maximum effort was not required to achieve good results, but only a certain amount. The second study investigated item- and person-level factors that influence test-taking disengagement. For tasks administering later and for more difficult tasks, the proportion of disengaged responses increased. The proportion of disengaged responses was higher among women. Individuals with lower admission scores, lower working memory capacity and lower self-reported effort also had higher rates of disengaged responses. In the third study, we investigated the role of test-taking effort in the knowledge acquisition through exploration behavior. Latent profile analysis of labeled behavioral data to monitor the effectiveness of the exploration strategy identified four groups. The degree of test-taking effort differed between groups and decreased to various degrees during testing. Our results suggest that successful problem solvers put in enough time and effort to solve problems. A sufficient amount of effort does not guarantee a successful outcome, but success is not possible without it. Therefore, practitioners should place considerable emphasis on using methods that improve students' test-taking effort.

Related Organizations
  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Upload OA version
Are you the author of this publication? Upload your Open Access version to Zenodo!
It’s fast and easy, just two clicks!