An Application of Hierarchical Kappa-type Statistics in the Assessment of Majority Agreement among Multiple Observers
1977/06/01 by J. Richard Landis, Gary G. Koch · 68 citations
Decision Sciences · #Multi-Criteria Decision Making
paper · doi:10.2307/2529786
Abstract
J. Richard Landis, Gary G. Koch, An Application of Hierarchical Kappa-type Statistics in the Assessment of Majority Agreement among Multiple Observers, Biometrics, Vol. 33, No. 2 (Jun., 1977), pp. 363-374
Cited by
- The Measurement of Observer Agreement for Categorical Data
- The effectiveness of an integrated<scp>STEM</scp>curriculum unit on middle school students' life science learning
- Associations between treatment adherence–competence–integrity (ACI) and adult psychotherapy outcomes: A systematic review and meta-analysis.
- Investigation of Response Aggregation Methods in Divergent Thinking Assessments
- Psychometric Properties of the Mini-Balance Evaluation Systems Test (Mini-BESTest) in Community-Dwelling Individuals With Chronic Stroke
- Self-Regulated Learning Interventions for Pre-service Teachers: a Systematic Review
- The use of the Vocal Profile Analysis for speaker characterization: Methodological proposals
- Assessing Physical Frailty and Fall-Risk Indicators with Social Robots: An in situ Evaluation with Older Adults
- Designing networks of freshwater and marine conservation areas accounting for cross‐realm connectivity and threat propagation
- From Gen Z to Boomers: Motivational drivers shaping Industry 5.0 and the future of work
- Training language models to be warm and empathetic makes them less reliable and more sycophantic
- Multiplatform ecosystems of professional learning: The case of the #CharlasEducativas
- Computing inter‐rater reliability and its variance in the presence of high agreement
- The continued influence of AI-generated deepfake videos despite transparency warnings
- Evaluating LLM-assisted research: stage-sensitive asymmetries in productivity and epistemic control
- Asking for Traces: A Vignette Study on Acceptability Norms and Personal Willingness to Donate Digital Trace Data
- Narrative power in electoral autocracies: The policy narrative behind the success of a pension movement
- (When) do teacher professional development interventions improve student Achievement? A meta-analysis of 128 high-quality studies
- Trophic convergence of marine vertebrate communities worldwide
- Validación de la versión española de las formas cortas del Urogenital Distress Inventory (UDI-6) y del Incontinence Impact Questionnaire (IIQ-7) en mujeres embarazadas
- Predicting student outcomes using digital logs of learning behaviors: Review, current standards, and suggestions for future work
- Scientific Open-Source Software Is Less Likely to Become Abandoned Than One Might Think! Lessons from Curating a Catalog of Maintained Scientific Software
- A meta-analysis of students’ academic learning losses over the course of the COVID-19 pandemic
- Gestural and Verbal Evidence of Conceptual Representation Differences in Blind and Sighted Individuals
- Instagram sukupuolittuneen politiikan alustana
- A Meta-Analysis of the Impact of Feedback Timing on Learning Outcomes in Computer-Assisted Learning
- Misunderstanding stance in tweets
- Evolutionary Drivers of Conspicuous Spots in Velvet Ants (Hymenoptera: <i>Dasymutilla</i> )
- Adjustment and campus friendliness for international students studying in the United States
- Comparative assessment of immunochromatographic test kits using low-molecular-weight antigens from cyst fluids of two different genotypes of <i>Taenia solium</i> for serodiagnosis of human cysticercosis
- Politicizing Disaster: Examining the Effect of Ideology on Media Framing of the Itaewon Crowd Crush Disaster in South Korea
- Developing a three-dimensional convolutional neural network for automated full-volume multi-tissue segmentation of the shoulder with comparisons to Goutallier classification and partial volume muscle quality analysis
- Association between milk anti- <i>Staphylococcus aureus</i> antibody, somatic cell count, and milk yield in lactating dairy cows
- Emotional Movement Kinematics Guide Twelve‐Month‐Olds’ Visual, but Not Manual, Exploration
- U is for Unease: Reasons for Mistrusting Overlap Measures for Reporting Clinical Trials
- Graded calls of the smallest terrestrial mammal, the Etruscan shrew, living in a closed habitat
- Addressing Failing Water Systems: A Qualitative Protocol for Intervention Research on Water Insecurity
- Forms and Functions of Gestures in Preverbal 12‐ to 15‐Months Old Infants
- Comprehensive spatial risk assessment using community-based species distribution models stratified by ant damage types
- Korean Children’s YouTube Use and Social Skills: A Linkage Analysis with Negative Interactions in Favorite YouTube Content
- Investigation of the Inter-Rater Reliability between Large Language Models and Human Raters in Qualitative Analysis
- Exploring the evolving motives underlying corporate social responsibility (CSR) disclosures in developing countries: the case of “political CSR” reporting
- Do Ethical AI Principles Matter to Users? A Large-Scale Analysis of User Sentiment and Satisfaction
- Helping or Homogenizing? GenAI as a Design Partner to Pre-Service SLPs for Just-in-Time Programming of AAC
- Towards standardized measurement of adverse events in spine surgery: conceptual model and pilot evaluation. [europepmc]
- Effectiveness of conservative treatments for the lumbosacral radicular syndrome: a systematic review. [europepmc]
- Response as a predictor of survival in patients with recurrent glioblastoma treated with bevacizumab. [europepmc]
- Code status discussions between attending hospitalist physicians and medical patients at hospital admission. [europepmc]
- Cardiovascular magnetic resonance in patients with pectus excavatum compared with normal controls. [europepmc]
- Comparison of diagnostic methods for the detection and quantification of the four sympatric Plasmodium species in field samples from Papua New Guinea. [europepmc]
- Cognitive and cognitive-motor interventions affecting physical functioning: a systematic review. [europepmc]
- Emergency department triage scales and their components: a systematic review of the scientific evidence. [europepmc]
- Shear wave elastography for breast masses is highly reproducible. [europepmc]
- Classifications in brief: the Neer classification for proximal humerus fractures. [europepmc]
- Prevalence and socio-behavioral influence of early childhood caries, ECC, and feeding habits among 6-36 months old children in Uganda and Tanzania. [europepmc]
- Do technical skills correlate with non-technical skills in crisis resource management: a simulation study. [europepmc]
- Evaluation of 3D blood flow patterns and wall shear stress in the normal and dilated thoracic aorta using flow-sensitive 4D CMR. [europepmc]
- Direct inpatient burden caused by foot-related conditions: a multisite point-prevalence study. [europepmc]
- Measurement of patient safety: a systematic review of the reliability and validity of adverse event detection with record review. [europepmc]
- TIPIC Syndrome: Beyond the Myth of Carotidynia, a New Distinct Unclassified Entity. [europepmc]
- Scoring ultrasound synovitis in rheumatoid arthritis: a EULAR-OMERACT ultrasound taskforce - Part 1: definition and development of a standardised, consensus-based scoring system. [europepmc]
- Scoring ultrasound synovitis in rheumatoid arthritis: a EULAR-OMERACT ultrasound taskforce-Part 2: reliability and application to multiple joints of a standardised consensus-based scoring system. [europepmc]
- High Agreement and High Prevalence: The Paradox of Cohen's Kappa. [europepmc]
- Validity of Actigraphy Compared to Polysomnography for Sleep Assessment in Children With Autism Spectrum Disorder. [europepmc]
- Accuracy of a Chatbot (Ada) in the Diagnosis of Mental Disorders: Comparative Case Study With Lay and Expert Users. [europepmc]
- Onset and duration of symptoms of loss of smell/taste in patients with COVID-19: A systematic review. [europepmc]
- Diagnostic Accuracy of 68Ga-PSMA-11 PET for Pelvic Nodal Metastasis Detection Prior to Radical Prostatectomy and Pelvic Lymph Node Dissection: A Multicenter Prospective Phase 3 Imaging Trial. [europepmc]
- Hyperspectral Imaging Combined with Artificial Intelligence in the Early Detection of Esophageal Cancer. [europepmc]
- Postmortem Assessment of Olfactory Tissue Degeneration and Microvasculopathy in Patients With COVID-19. [europepmc]
Related