Weighted κ
Kappa statistic for ordinal scales — weighs near misclassifications more mildly than distant ones.
Also known as: weighted kappa, κ_w, Cicchetti–Allison kappa
Weighted κ extends Cohen κ with a weight matrix that reflects how far apart two classes lie on the ordinal scale. Standard for steps:
Quadratic weighting (Cicchetti/Allison 1971) is the standard and penalises distant misclassifications (grade 1 instead of 5) markedly more than near ones (3 instead of 4). .
See also
Used in
In the Algorithm Lab
Sources
- Cohen, J. (1968). Weighted kappa: Nominal scale agreement with provision for scaled disagreement. Psychological Bulletin, 70(4), 213–220.
- Cicchetti, D.V. & Allison, T. (1971). A new procedure for assessing reliability of scoring EEG sleep recordings. American Journal of EEG Technology, 11, 101–110.