Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ Sydney eScholarshiparrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
Sydney eScholarship
Research . 2023
versions View all 1 versions
addClaim

An Alternative Scoring Approach for Best-Worst Scaling (BWS)

Authors: Wei, Edward; Burke, Paul F.;

An Alternative Scoring Approach for Best-Worst Scaling (BWS)

Abstract

The paper proposes an alternative scoring approach for the Best-Worst scaling (BWS) Object Case to capture both preference heterogeneity and experimental design differences to improve the prediction accuracy at the individual level. The unduplicated and highly unique scores across individuals also provide helpful input for further analysis, such as hybrid models to help understand people’s preferences in other tasks. Whilst the existing BWS scoring methods, including the most commonly used best-minus-worst and the best-over-worst ratio scores, have been applied primarily to elicit preference and ranking at both aggregate and individual levels, there are limitations such as equally scored items when we predict choices and order. We propose an alternative approach to target several limitations of existing methods. The proposed scoring approach can make several contributions: 1) it breaks equality in scores; 2) it introduces instruments to minimise design-induced effects such as different item co-occurrences in different balanced incomplete block designs (BIBD); and 3) it introduces a risk-averse instrument to lower the impact of incorrect predictions. We used seven empirical BWS Case I data sets with respondents completing full BIBD designs varied to test the new scoring against the current scoring. Results show a universal improvement in prediction accuracy. Compared to the present method, generating a limited set of discrete scores, the new approach generates almost unduplicated scores for object items across individuals with continuous distributions.

Country
Australia
Related Organizations
Keywords

TOURISM AND SERVICES::3509 Transportation, logistics and supply chains::350902 Intelligent mobility, choice model, ranking, :35 COMMERCE, MANAGEMENT, TOURISM AND SERVICES::3509 Transportation, logistics and supply chains::350902 Intelligent mobility [ANZSRC FoR code], MANAGEMENT, prediction accuracy, 310, Best-worst scaling (BWS), ANZSRC FoR code::35 COMMERCE

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Green