New variances for various kappa coefficients based on the unbiased estimator of the expected index of agreements

2024/04/09 by Antonio Martín Andrés, Andrés, Antonio Martín, M. Álvarez Hernández +1
Decision Sciences · #FOS: Mathematics #Reliability and Agreement in Measurement #Statistics Theory (math.ST)

paper · pdf · doi:10.48550/arxiv.2404.06295

openalex publication_date 2024/04/09 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01

Abstract

Recently Martín Andrés and Álvarez Hernández (2024) have proposed new estimators of various kappa coefficients. These estimators are based on the unbiased estimator of the expected index of agreement of each population coefficient. In their article, these authors propose variance formulas based on the univariate delta method. Here new formulas are proposed that are based on the multivariate delta method.

Related

• An Application of Hierarchical Kappa-type Statistics in the Assessment of Majority Agreement among Multiple Observers
• Coefficient Kappa: Some Uses, Misuses, and Alternatives
• A Note on the Interpretation of Weighted Kappa and its Relations to Other Rater Agreement Statistics for Metric Scales
• A Proposed Solution to the Base Rate Problem in the Kappa Statistic
• A Linear Relationship between Correlation and Cohen's Kappa for Binary Data and Simulating Multivariate Nominal and Ordinal Data with Specified Kappa Matrix