Maximum likelihood estimation of the kappa coefficient from models of matched binary responses

Abstract

We present an estimate of the kappa‐coefficient of agreement between two methods of rating based on matched pairs of binary responses and show that the estimate depends on the common intraclass correlation coefficient between the pairs. Via Monte Carlo simulation, we investigate power of the test of significance on kappa, and the large sample bias and variance of its maximum likelihood estimator.