Weighted κ

Kappa statistic for ordinal scales — weighs near misclassifications more mildly than distant ones.

Also known as: weighted kappa, κ_w, Cicchetti–Allison kappa

Weighted κ extends Cohen κ with a weight matrix that reflects how far apart two classes lie on the ordinal scale. Standard for steps:

Quadratic weighting (Cicchetti/Allison 1971) is the standard and penalises distant misclassifications (grade 1 instead of 5) markedly more than near ones (3 instead of 4). .

See also

Used in

In the Algorithm Lab

Sources

  • Cohen, J. (1968). Weighted kappa: Nominal scale agreement with provision for scaled disagreement. Psychological Bulletin, 70(4), 213–220.
  • Cicchetti, D.V. & Allison, T. (1971). A new procedure for assessing reliability of scoring EEG sleep recordings. American Journal of EEG Technology, 11, 101–110.