
Shepperd and MacDonell "Evaluating prediction systems in software project estimation". Information and Software Technology 54 (8), 820-827, 2012, proposed an improved measure of the effectiveness of predictors based on comparing them with random guessing. They suggest estimating the performance of random guessing using a Monte?Carlo scheme which unfortunately excludes some correct guesses. This biases their MAR P 0 to be slightly too big, which in turn causes their standardised accuracy measure SA to over estimate slightly. In commonly used software engineering datasets it is practical to calculate an unbiased MAR P 0 exactly.
Search Based Software Engineering, empirical validation, prediction systems, Software Engineering, randomisation techniques
Search Based Software Engineering, empirical validation, prediction systems, Software Engineering, randomisation techniques
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 70 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
