The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability

1973/10/01 by Joseph L. Fleiss, Jacob Cohen · 64 citations
Decision Sciences · Mathematics · Medicine · #Reliability and Agreement in Measurement #Advanced Statistical Methods and Models #Hemodynamic Monitoring and Therapy

paper · doi:10.1177/001316447303300309

Citations

• A Coefficient of Agreement for Nominal Scales

Cited by

• The reliability of the functional independence measure: A quantitative review
• A Note on the Interpretation of Weighted Kappa and its Relations to Other Rater Agreement Statistics for Metric Scales
• The Boston bowel preparation scale: a valid and reliable instrument for colonoscopy-oriented research
• The Measurement of Observer Agreement for Categorical Data
• The Manual Ability Classification System (MACS) for children with cerebral palsy: scale development and evidence of validity and reliability
• A Revised Diagnostic Classification of Canine Glioma: Towards Validation of the Canine Glioma Patient as a Naturally Occurring Preclinical Model for Human Glioma
• Precision of Health-Related Quality-of-Life Data Compared With Other Clinical Measures
• Dynamic Commonsense Coordination for Empathetic Response Generation
• Inter-Rater Reliability Methods in Qualitative Case Study Research
• 3D multi‐view squeeze‐and‐excitation convolutional neural network for lung nodule classification
• Controllability of Stressful Events and Satisfaction With Spouse Support Behaviors
• Using Natural Language Processing to Automatically Detect Self-Admitted Technical Debt
• Textverständlichkeit und kognitive Belastung beim Lernen mit Text und Hypertext
• SoliReward: Mitigating Susceptibility to Reward Hacking and Annotation Noise in Video Generation Reward Models
• Enhancing Job Matching: Occupation, Skill and Qualification Linking with the ESCO and EQF taxonomies
• Cross-replication Reliability -- An Empirical Approach to Interpreting Inter-rater Reliability
• Fantastic Bugs and Where to Find Them in AI Benchmarks
• De-identification of Privacy-related Entities in Job Postings
• Learning Neural Templates for Recommender Dialogue System
• Bien Educado: Measuring the social behaviors of Mexican American children
• MultiOpEd: A Corpus of Multi-Perspective News Editorials
• Consultorio Médico Local Tipo I. Vícar, Almería
• The Paris 1976 Wine Tastings Revisited Once More: Comparing Ratings of Consistent and Inconsistent Tasters
• Identifying & Interactively Refining Ambiguous User Goals for Data Visualization Code Generation
• CFVBench: A Comprehensive Video Benchmark for Fine-grained Multimodal Retrieval-Augmented Generation
• Whose Opinions Matter? Perspective-aware Models to Identify Opinions of Hate Speech Victims in Abusive Language Detection
• Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Models
• A Note on the Use of Categorical Subscores
• QUARTZ : QA-based Unsupervised Abstractive Refinement for Task-oriented Dialogue Summarization
• Beyond kappa: A review of interrater agreement measures
• AgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approach
• Impact of schematic representations of road maps on pedestrian route planning
• Psychometric properties of the EQ-5D-5L: a systematic review of the literature
• Testing the WHO Hand Hygiene Self-Assessment Framework for usability and reliability
• Resilients, Overcontrollers, and Undercontrollers: The replicability of the three personality prototypes across informants
• T2R-bench: A Benchmark for Generating Article-Level Reports from Real World Industrial Tables
• Generating Multiple Diverse Responses with Multi-Mapping and Posterior Mapping Selection
• Discovering the Potential of Automated Phraseological Interference Error Detection: A Transformer-Based Approach
• SentiPers: A Sentiment Analysis Corpus for Persian
• Psychometric characteristics of the Spanish version of instruments to measure neck pain disability. [europepmc]
• Reliability of Ashworth and Modified Ashworth scales in children with spastic cerebral palsy. [europepmc]
• Agreement, reliability and validity in 3 shoulder questionnaires in patients with rotator cuff disease. [europepmc]
• Effect of rater training on reliability and accuracy of mini-CEX scores: a randomized, controlled trial. [europepmc]
• Validity/reliability of PHQ-9 and PHQ-2 depression scales among adults living with HIV/AIDS in western Kenya. [europepmc]
• Reliability and validity of triage systems in paediatric emergency care. [europepmc]
• Feasibility, reliability, and validity of the EQ-5D-Y: results from a multinational study. [europepmc]
• Health care providers underestimate symptom intensities of cancer patients: a multicenter European study. [europepmc]
• Prevention of ventilator-associated pneumonia, mortality and all intensive care unit acquired infections by topically applied antimicrobial or antiseptic agents: a meta-analysis of randomized controlled trials in intensive care units. [europepmc]
• Texture analysis of cartilage T2 maps: individuals with risk factors for OA have higher and more heterogeneous knee cartilage MR T2 compared to normal controls--data from the osteoarthritis initiative. [europepmc]
• Shear wave elastography for breast masses is highly reproducible. [europepmc]
• Enhancing medical students' communication skills: development and evaluation of an undergraduate training program. [europepmc]
• Percutaneous and surgical tracheostomy in critically ill adult patients: a meta-analysis. [europepmc]
• Tracking of overweight and obesity from early childhood to adolescence in a population-based cohort - the Tromsø Study, Fit Futures. [europepmc]
• Effectiveness and success factors of educational inhaler technique interventions in asthma & COPD patients: a systematic review. [europepmc]
• A Deep Learning-Based Radiomics Model for Prediction of Survival in Glioblastoma Multiforme. [europepmc]
• A Systematic Review of Studies Comparing the Measurement Properties of the Three-Level and Five-Level Versions of the EQ-5D. [europepmc]
• Análise de concordância em estudos clínicos e experimentais. [europepmc]
• The usefulness of cardiac CT in the diagnosis of perivalvular complications in patients with infective endocarditis. [europepmc]
• Deep Learning-Assisted Diagnosis of Cerebral Aneurysms Using the HeadXNet Model. [europepmc]
• The superior predictive value of 166 Ho-scout compared with 99m Tc-macroaggregated albumin prior to 166 Ho-microspheres radioembolization in patients with liver metastases. [europepmc]
• Comparability of three intraocular pressure measurement: iCare pro rebound, non-contact and Goldmann applanation tonometry in different IOP group. [europepmc]
• CO-RADS: A Categorical CT Assessment Scheme for Patients Suspected of Having COVID-19-Definition and Evaluation. [europepmc]
• A Step-by-Step Process on Sample Size Determination for Medical Research. [europepmc]
• Kappa statistic considerations in evaluating inter-rater reliability between two raters: which, when and context matters. [europepmc]