
doi: 10.1007/bf00162917
pmid: 24179020
Checklists and rating scales are both used for assessing examinees in standardized-patient (SP) examinations. A common presumption, is that checklists are more objective than and hence superior to rating scales with respect to psychometric properties such as reliability. Recently, this presumption has been questioned and studies have been cited which support the clain that "objectified methods do not inherently provide more reliable scores." The purpose of this study was to further explore this issue, using a specially designed checklist/rating scale form for assessing interpersonal and communication skills. Methods. A 26-item checklist/rating scale form was developed, which consisted of five sections of 3 to 7 checklist items each, with a space provided at the end of each section for the SP to make a single global rating of the items in that section. Analyses were performed on data for 1,048 fourth-year medical students in the eight schools in the New York City Consortium, tested on the 7-case SP examination administered at The Morchand Center of Mount Sinai School of Medicine. Results/Conclusion. The intercase reliabilities for the checklist scores and ratings, respectively, were: 0.33 and 0.39 for eliciting information, 0.33 and 0.39 for non-verbal behavior, 0.55 and 0.52 for patient education, 0.48 and 0.45 for professional manner, and 0.49 and 0.52 for patient satisfaction. The correlations between the checklist scores and ratings for the five sections were 0.66, 0.60, 0.80, 0.69, and 0.75, respectively. The pattern of these results provides further support for the claim that "objectified" measures, like checklists, "do not inherently provide more reliable scores."
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 8 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
