Multidimensionality and Structural Coefficient Bias in Structural Equation Modeling
2012/07/17 by Steven P. Reise, Richard Scheines, Keith F. Widaman +1 · 755 citations
Computer Science · Decision Sciences · Mathematics · #Advanced Statistical Modeling Techniques #Econometrics #Factor analysis #Index (typography) #Mathematics #Mean squared error #Psychometric Methodologies and Testing #Residual #Statistic #Statistics #Structural equation modeling #Technology Adoption and User Behaviour #Variance (accounting)
paper · open access · doi:10.1177/0013164412449831
published in Educational and Psychological Measurement 73(1), 5-26 (SAGE Publishing)
openalex publication_date 2012/07/17 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05
Abstract
In this study, the authors consider several indices to indicate whether multidimensional data are “unidimensional enough” to fit with a unidimensional measurement model, especially when the goal is to avoid excessive bias in structural parameter estimates. They examine two factor strength indices (the explained common variance and omega hierarchical) and several model fit indices (root mean square error of approximation, comparative fit index, and standardized root mean square residual). These statistics are compared in population correlation matrices determined by known bifactor structures that vary on the (a) relative strength of general and group factor loadings, (b) number of group factors, and (c) number of items or indicators. When fit with a unidimensional measurement model, the degree of structural coefficient bias depends strongly and inversely on explained common variance, but its effects are moderated by the percentage of correlations uncontaminated by multidimensionality, a statistic that rises combinatorially with the number of group factors. When the percentage of uncontaminated correlations is high, structural coefficients are relatively unbiased even when general factor strength is low relative to group factor strength. On the other hand, popular structural equation modeling fit indices such as comparative fit index or standardized root mean square residual routinely reject unidimensional measurement models even in contexts in which the structural coefficient bias is low. In general, such statistics cannot be used to predict the magnitude of structural coefficient bias.
Cited by
- Informing measurement of gender differences in suicide risk and resilience: A national study of United States military veterans
- The Rediscovery of Bifactor Measurement Models
- Assessing the Size of Model Misfit in Structural Equation Models
- Measuring and validating autistic burnout
- Establishing a common metric for depressive symptoms: Linking the BDI-II, CES-D, and PHQ-9 to PROMIS Depression.
- The Math and Science Engagement Scales: Scale development, validation, and psychometric properties
- Putting the Instructional Leadership–Student Achievement Relation in Context: A Meta-Analytical Big Data Study Across Cultures and Time
- Cultural shift for pro-environmental behavioural change: Developing and validating the Environmental Culture in Organisations (ECO) scale
- Ruminative response scale for eating disorders: bifactor model and measurement invariance in a Portuguese community sample
- Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures
- Measuring autistic burnout: A psychometric validation of the AASPIRE Autistic Burnout Measure in autistic adults
- Conceptualizing the factor structure of parents’ math anxiety and associations with children's mathematics skills
- The Moral Injury Symptoms Scale–Military Version–Short Form: Further Scale Validation in a U.S. Veteran Sample
- Teachers' professional vision, pedagogical content knowledge and beliefs: On its relation and differences between pre-service and in-service teachers
- Internal structure of the Community Assessment of Psychic Experiences—Positive (CAPE-P15) scale: Evidence for a general factor
- Construct Validity of the Professional Quality of Life (ProQoL) Scale in a Sample of Child Protection Workers
- Measuring Personal Growth and Development in Context: Evidence of Validity in Educational and Work Settings
- Evaluating bifactor models: Calculating and interpreting statistical indices.
- Establishing a common metric for self-reported anxiety: linking the MASQ, PANAS, and GAD-7 to PROMIS Anxiety. [europepmc]
- Establishing a common metric for depressive symptoms: linking the BDI-II, CES-D, and PHQ-9 to PROMIS depression. [europepmc]
- Structure of the Wechsler Intelligence Scale for Children - Fourth Edition in a Group of Children with ADHD. [europepmc]
- Psychometric Properties of the Satisfaction With Life Scale in People With Traumatic Brain, Spinal Cord, or Burn Injury: A National Institute on Disability, Independent Living, and Rehabilitation Research Model System Study. [europepmc]
- Psychometric Evaluation of the Short Sensory Profile in Youth with Autism Spectrum Disorder. [europepmc]
- Validation of two PROMIS item banks for measuring social participation in the Dutch general population. [europepmc]
- The Factor Structure of the Forms of Self-Criticising/Attacking & Self-Reassuring Scale in Thirteen Distinct Populations. [europepmc]
- Two is more valid than one, but is six even better? The factor structure of the Self-Compassion Scale (SCS). [europepmc]
- Structural Validity of the World Assumption Scale. [europepmc]
- Seeking certainty about Intolerance of Uncertainty: Addressing old and new issues through the Intolerance of Uncertainty Scale-Revised. [europepmc]
- Construct Validity of the Professional Quality of Life (ProQoL) Scale in a Sample of Child Protection Workers. [europepmc]
- Psychometric evaluation of two short versions of the Revised Child Anxiety and Depression Scale. [europepmc]
- Graded response model fit, measurement invariance and (comparative) precision of the Dutch-Flemish PROMIS® Upper Extremity V2.0 item bank in patients with upper extremity disorders. [europepmc]
- Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis. [europepmc]
- The Dimensionality of the 12-Item General Health Questionnaire (GHQ-12): Comparisons of Factor Structures and Invariance Across Samples and Time. [europepmc]
- Factorial validity of the Twi versions of five measures of mental health and well-being in Ghana. [europepmc]
- Establishing a common metric for patient-reported outcomes in cancer patients: linking patient reported outcomes measurement information system (PROMIS), numerical rating scale, and patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). [europepmc]
- Content validity and psychometric evaluation of the Functional Assessment of Chronic Illness Therapy-Fatigue scale in patients with chronic lymphocytic leukemia. [europepmc]
- Psychometric properties of the PROMIS-57 questionnaire, Norwegian version. [europepmc]
- Reliability Estimation in Multidimensional Scales: Comparing the Bias of Six Estimators in Measures With a Bifactor Structure. [europepmc]
- Psychometric properties of the patient-reported outcomes measurement information system scale v1.2: global health (PROMIS-GH) in a Dutch general population. [europepmc]
- A Comparison of Reliability Estimation Based on Confirmatory Factor Analysis and Exploratory Structural Equation Models. [europepmc]
- Defining the p -factor: an empirical test of five leading theories. [europepmc]
- Item response theory and differential test functioning analysis of the HBSC-Symptom-Checklist across 46 countries. [europepmc]
- Psychometric evaluation of the Suicide Cognitions Scale-Revised (SCS-R). [europepmc]
Related