International Large-Scale Assessment Data

2010/03/01 by Leslie Rutkowski, Eugenio Gonzalez, Eugenio González +2 · 17 citations
Decision Sciences · Mathematics · #Evaluation and Performance Assessment #Statistical Methods and Bayesian Inference #Advanced Causal Inference Techniques

paper · doi:10.3102/0013189x10363170

Abstract

The technical complexities and sheer size of international large-scale assessment (LSA) databases often cause hesitation on the part of the applied researcher interested in analyzing them. Further, inappropriate choice or application of statistical methods is a common problem in applied research using these databases. This article serves as a primer for researchers on the issues and methods necessary for obtaining unbiased results from LSA data. The authors outline the issues surrounding the analysis and reporting of LSA data, with a particular focus on three prominent international surveys. In addition, they make recommendations targeted at applied researchers regarding best analysis and reporting practices when using these databases.

Cited by

• Comparing the Efficiency of Schools Through International Benchmarking: Results From an Empirical Analysis of OECD PISA 2012 Data
• Methodological Reflections on PISA'S Creative Thinking Assessment
• PISA 2022 Creative Thinking Assessment: Opportunities, Challenges, and Cautions
• How effective are educational systems? A value-added approach to measure trends in PIRLS
• Need-supportive teaching is associated with reading achievement via intrinsic motivation across eight cultures
• Exploring Validity Evidence for Mathematics Self-Concept of Adolescents: Key Findings from PISA 2022
• Longitudinal insights into academic resilience in PISA in Italy: the role of prior achievement and upper-secondary school factors
• How Can Skill Mismatch be Measured? New Approaches with PIAAC
• It is not just your opinion. Gender equity endorsement of Latin American students and their peers at school
• Acculturation and School Adjustment of Immigrant Youth in Six European Countries: Findings from the Programme for International Student Assessment (PISA). [europepmc]
• Regression Analysis of ICT Impact Factors on Early Adolescents' Reading Proficiency in Five High-Performing Countries. [europepmc]
• Validity of Three IRT Models for Measuring and Controlling Extreme and Midpoint Response Styles. [europepmc]
• Analyzing Large-Scale Studies: Benefits and Challenges. [europepmc]
• Global pattern in hunger and educational opportunity: a multilevel analysis of child hunger and TIMSS mathematics achievement. [europepmc]
• Cultural variation in the SES-gender interaction in student achievement. [europepmc]
• Pedagogical practices and civic knowledge and engagement in Latin America: Multilevel analysis using ICCS data. [europepmc]
• Systematic review of protective factors related to academic resilience in children and adolescents: unpacking the interplay of operationalization, data, and research method. [europepmc]

Related

• Partial Identification of Mean Achievement in ILSA Studies with Multi-Stage Stratified Sample Design and Student Non-Participation
• International Large Scale Assessments: Current Status and Ways Forward
• Statistical Analyses with Sampling Weights in Large-Scale Assessment and Survey
• Preferred Reporting Items for Complex Sample Survey Analysis (PRICSSA)
• An Assessment Tool for Academic Research Managers in the Third World