
handle: 2123/31553
The paper proposes an alternative scoring approach for the Best-Worst scaling (BWS) Object Case to capture both preference heterogeneity and experimental design differences to improve the prediction accuracy at the individual level. The unduplicated and highly unique scores across individuals also provide helpful input for further analysis, such as hybrid models to help understand people’s preferences in other tasks. Whilst the existing BWS scoring methods, including the most commonly used best-minus-worst and the best-over-worst ratio scores, have been applied primarily to elicit preference and ranking at both aggregate and individual levels, there are limitations such as equally scored items when we predict choices and order. We propose an alternative approach to target several limitations of existing methods. The proposed scoring approach can make several contributions: 1) it breaks equality in scores; 2) it introduces instruments to minimise design-induced effects such as different item co-occurrences in different balanced incomplete block designs (BIBD); and 3) it introduces a risk-averse instrument to lower the impact of incorrect predictions. We used seven empirical BWS Case I data sets with respondents completing full BIBD designs varied to test the new scoring against the current scoring. Results show a universal improvement in prediction accuracy. Compared to the present method, generating a limited set of discrete scores, the new approach generates almost unduplicated scores for object items across individuals with continuous distributions.
TOURISM AND SERVICES::3509 Transportation, logistics and supply chains::350902 Intelligent mobility, choice model, ranking, :35 COMMERCE, MANAGEMENT, TOURISM AND SERVICES::3509 Transportation, logistics and supply chains::350902 Intelligent mobility [ANZSRC FoR code], MANAGEMENT, prediction accuracy, 310, Best-worst scaling (BWS), ANZSRC FoR code::35 COMMERCE
TOURISM AND SERVICES::3509 Transportation, logistics and supply chains::350902 Intelligent mobility, choice model, ranking, :35 COMMERCE, MANAGEMENT, TOURISM AND SERVICES::3509 Transportation, logistics and supply chains::350902 Intelligent mobility [ANZSRC FoR code], MANAGEMENT, prediction accuracy, 310, Best-worst scaling (BWS), ANZSRC FoR code::35 COMMERCE
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
