Accuracy of Revised and Traditional Parallel Analyses for Assessing Dimensionality with Binary Data

2015/04/21 by Samuel B. Green, Nickalus Redell, Marilyn S. Thompson +1 · 14 citations
Decision Sciences · Computer Science · Psychology · #Psychometric Methodologies and Testing #Advanced Statistical Modeling Techniques #Cognitive Abilities and Testing

paper · doi:10.1177/0013164415581898

Abstract

Parallel analysis (PA) is a useful empirical tool for assessing the number of factors in exploratory factor analysis. On conceptual and empirical grounds, we argue for a revision to PA that makes it more consistent with hypothesis testing. Using Monte Carlo methods, we evaluated the relative accuracy of the revised PA (R-PA) and traditional PA (T-PA) methods for factor analysis of tetrachoric correlations between items with binary responses. We manipulated five data generation factors: number of observations, type of factor model, factor loadings, correlation between factors, and distribution of thresholds. The R-PA method tended to be more accurate than T-PA, although not uniformly across conditions. R-PA tended to perform better relative to T-PA if the underlying model (a) was unidimensional but had some unique items, (b) had highly correlated factors, or (c) had a general factor as well as a group factor. In addition, R-PA tended to outperform T-PA if items had higher factor loadings and sample size was large. A major disadvantage of the T-PA method was that it frequently yielded inflated Type I error rates.

Cited by

• Methodological issues in measuring subjective well-being and quality-of-life: Applications to assessment of affect in older, chronically and cognitively impaired, ethnically diverse groups using the Feeling Tone Questionnaire. [europepmc]
• Proportion of Indicator Common Variance Due to a Factor as an Effect Size Statistic in Revised Parallel Analysis. [europepmc]
• Revised Parallel Analysis With Nonnormal Ability and a Guessing Parameter. [europepmc]
• Simple-Structure Multidimensional Item Response Theory Equating for Multidimensional Tests. [europepmc]
• Using Fit Statistic Differences to Determine the Optimal Number of Factors to Retain in an Exploratory Factor Analysis. [europepmc]
• Incorporating Uncertainty Into Parallel Analysis for Choosing the Number of Factors via Bayesian Methods. [europepmc]
• On the Detection of the Correct Number of Factors in Two-Facet Models by Means of Parallel Analysis. [europepmc]
• Determining the Number of Factors When Population Models Can Be Closely Approximated by Parsimonious Models. [europepmc]
• Assessing Dimensionality in Dichotomous Items When Many Subjects Have All-Zero Responses: An Example From Psychiatry and a Solution Using Mixture Models. [europepmc]
• Factor retention in ordered categorical variables: Benefits and costs of polychoric correlations in eigenvalue-based testing. [europepmc]
• Using Multiple Imputation to Account for the Uncertainty Due to Missing Data in the Context of Factor Retention. [europepmc]
• Comparing Accuracy of Parallel Analysis and Fit Statistics for Estimating the Number of Factors With Ordered Categorical Data in Exploratory Factor Analysis. [europepmc]
• Improving the Use of Parallel Analysis by Accounting for Sampling Variability of the Observed Correlation Matrix. [europepmc]
• Factor Retention in Exploratory Multidimensional Item Response Theory. [europepmc]

Related

• Remarks on Parallel Analysis
• Exploring the Sensitivity of Horn's Parallel Analysis to the Distributional Form of Random Data
• Assessing unidimensionality: A comparison of Rasch Modeling, Parallel Analysis, and TETRAD
• Determining the Number of Factors to Retain in EFA: An easy-to-use computer program for carrying out Parallel Analysis
• Bi-cross-validation for factor analysis