
Gamification is becoming a widely used technique in an attempt to improve engagement and effectiveness of learning, with virtual rewards (often in the form of badges) frequently forming a core part of this structure. But how do badges actually work? Recent studies in gamification have clearly identified that while we can say this approach works, any analysis of the success stories quickly confirms that context is essential in both the system we gamify and the users that take part. In the absence of context, a badge is obviously meaning and valueless, but studies in badge use generally refer to success without focusing on the underlying process and, in some cases, report significance without effect size, report the badge without the process or do not sufficiently isolate the variables to allow us to address what the influence of the badge is. In this paper, we classify the existing work to identify the existing research where badges have been evaluated in a way that appears significant, with properly established control groups, isolation of factors and longitudinal considerations, and with an exposure of the underlying process to determine if what we are seeing is a successful process in action that has a badge at the end, rather than a process that has been made successful through badge use. A badge system can be a proxy for scaffolding and an individual badge can give focus much in the way we would expect in cognitive apprenticeship but both of these outcomes have strong implications that there is a definite limit to how many badges we award, the way in which they are contextualised and the training framework in which they are presented.
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 10 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
