Reliability Studies of Psychiatric Diagnosis

1981/04/01 by William M. Grove · 450 citations
Decision Sciences · Economics, Econometrics and Finance · Medicine · Psychology · #Clinical Reasoning and Diagnostic Skills #Clinical psychology #Health Systems, Economic Evaluations, Quality of Life #Psychiatry #Psychology #Reliability (semiconductor) #Reliability and Agreement in Measurement

paper · doi:10.1001/archpsyc.1981.01780290042004

published in Archives of General Psychiatry 38(4), 408 (American Medical Association)

openalex publication_date 1981/04/01 · openalex created_date 2016/06/24 · openalex updated_date 2026/07/30

Abstract

The existing literature on the reliability of psychiatric diagnosis falls into two periods, the earlier reporting low reliability and the latter reporting much higher figures. The reasons for this trend are examined in the context of a discussion of the design of diagnostic reliability studies. The problems of research design and execution in studies of diagnostic reliability are reviewed, and statistical problems are examined. Solutions to many of these problems ae suggested, including recommendations of appropriate reliability coefficients and data analyses.

Cited by

• The International Personality Disorder Examination
• A Proposed Solution to the Base Rate Problem in the Kappa Statistic
• OPCRIT+: an electronic system for psychiatric diagnosis and data collection in clinical and research settings
• Chance‐Corrected Interrater Agreement Statistics for Two‐Rater Dichotomous Responses: A Method Review With Comparative Assessment Under Possibly Correlated Decisions
• High agreement but low Kappa: I. the problems of two paradoxes
• Cognitive-Behavioural Therapy vs. Mindfulness-Based Cognitive Therapy for Obsessive-Compulsive Disorder: Effectiveness and Treatment Mechanisms
• Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.
• Diagnosis of Nonpsychotic Patients in Community Clinics
• Impact of Structured Clinical Interviews on Physicians' Practices in Community Mental Health Settings
• The Future is Knocking: How Artificial Intelligence Will Fundamentally Change Psychiatry
• The DSM Diagnostic Criteria for Sexual Sadism
• The DSM Diagnostic Criteria for Sexual Masochism
• An Examination of Interrater Reliability for Scoring the Rorschach Comprehensive System in Eight Data Sets
• Factors and Taxa, Traits and Types, Differences of Degree and Differences in Kind
• Factors affecting agreement between severely mentally ill alcohol abusers' and collaterals' reports of alcohol and other substance abuse. [europepmc]
• Congruence between clinical and research-based psychiatric assessment in bariatric surgical candidates. [europepmc]
• Gender differences in life events prior to onset of major depressive disorder: the moderating effect of age. [europepmc]
• The Reliability of Psychiatric Diagnosis Revisited: The Clinician's Guide to Improve the Reliability of Psychiatric Diagnosis. [europepmc]
• Early parental loss and depression history: associations with recent life stress in major depressive disorder. [europepmc]
• OPCRIT+: an electronic system for psychiatric diagnosis and data collection in clinical and research settings. [europepmc]
• Psychiatric diagnostic interviews for children and adolescents: a comparative study. [europepmc]
• Psychometric properties of a sign language version of the Mini International Neuropsychiatric Interview (MINI). [europepmc]
• The development of the DSM-5 Cultural Formulation Interview-Fidelity Instrument (CFI-FI): a pilot study. [europepmc]
• The Evolution of the Classification of Psychiatric Disorders. [europepmc]
• Performance of intraclass correlation coefficient (ICC) as a reliability index under various distributions in scale reliability studies. [europepmc]
• Comparison of depression prevalence estimates in meta-analyses based on screening tools and rating scales versus diagnostic interviews: a meta-research review. [europepmc]
• Interrater reliability estimators tested against true interrater reliabilities. [europepmc]
• Measuring Agreement Using Guessing Models and Knowledge Coefficients. [europepmc]
• A novel agreement statistic using data on uncertainty in ratings. [europepmc]
• Psychometric Properties of the Diagnostic Interview for Sexual Dysfunctions in Women in a Symptom-Reporting Sample. [europepmc]
• Endocannabinoid concentrations in major depression: effects of childhood maltreatment and relation to hippocampal volume. [europepmc]
• Stressful Life Events and Reward Processing in Adults: Moderation by Depression and Anhedonia. [europepmc]

Related

• The New Crisis of Confidence in Psychiatric Diagnosis
• The six most essential questions in psychiatric diagnosis: a pluralogue part 1: conceptual and definitional issues in psychiatric diagnosis
• The Initial Field Trials of DSM-5: New Blooms and Old Thorns
• An Inventory for Measuring Depression
• A comparison of DSM and ICD classifications of mental disorder