Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC

2016/08/30 by Aki Vehtari, Andrew Gelman, Jonah Gabry · 144 citations
Computer Science · Engineering · Mathematics · #Fault Detection and Control Systems #Gaussian Processes and Bayesian Inference #Statistical Methods and Inference

paper · doi:10.1007/s11222-016-9696-4

openalex created_date 2016/06/24 · openalex publication_date 2016/08/30 · openalex updated_date 2026/07/30

Citations

• A Predictive Approach to Model Selection

Cited by

• The Bradley-Terry Stochastic Block Model
• Disentangling the effects of multifunctional forestry practices on the abundances of birds and their invertebrate prey
• Photosynthesis, heat, and structure: an evident hierarchy of environmental conditions driving wetland carbon assimilation
• Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle
• Changing determinants of international conservation funding committed to major deforestation regions in South America
• Separating intrinsic from extrinsic stomatal control in different soils
• The Scope and Limits of Iconic Prosody: Head Angle Predicts <i>f</i> 0 Changes While Object Size Effects Are Absent
• An inverse correlation between structural linguistic and human genetic diversity
• Making Machine Learning Accessible for Developmental Science: The Case of Automated Face Detection
• Anhedonic Traits Do Not Impair Performance in a 3-Arm Bandit Task
• Context ameliorates but does not eliminate garden-pathing: Novel insights from latent-process modeling
• Spatiotemporal variation of ecosystem metabolism in a eutrophic, polymictic reservoir: water column stability begets metabolism stability
• The perception of prosocial agents by chimpanzees and humans
• Conformal Bayesian Computation
• Reality-check for Econophysics: Likelihood-based fitting of\n physics-inspired market models to empirical data
• Understanding the effectiveness of government interventions against the resurgence of COVID-19 in Europe
• R-squared for Bayesian Regression Models
• Thermal adaptation and the potential anticipation of overnight weather in the nesting decisions of chimpanzees
• Linking environmental and pollination‐related factors to touch‐sensitive stigma closure dynamics in <i>Mazus miquelii</i>
• Episodic memory facilitates flexible decision making via access to detailed events
• Spatially coordinated predation with division of labor increases feeding success in killer whales
• Controllability changes pain perception by increasing the precision of expectations
• Building on models—a perspective for computational neuroscience
• Dispersal and Gene Flow Among Potential Spawners: Source–Sink Structure Among Populations of Anadromous Brown Trout Exposed to Multifaceted Anthropogenic Impacts
• Bayesian analysis of flexible Heckman selection models using Hamiltonian Monte Carlo
• A large-scale investigation of vowel co-occurrence patterns in the world’s lexicons
• Efficient scenario analysis in real-time Bayesian election forecasting via sequential meta-posterior sampling
• Centered-Innovation MA for Bayesian Dirichlet ARMA: Theoretical Equivalence and an Application to Bank-Asset Shares
• Infant-directed speech does not always involve exaggerated vowel distinctions: Evidence from Danish
• Genomic Identification and Characterization of Saxitoxin Producing Cyanobacteria in Western Lake Erie Harmful Algal Blooms
• Managing multiple threats: Evaluating the efficacy of broad-scale introduced predator management in improving native mammal resilience to fire
• Language as shaped by the environment: linguistic construal in a collaborative spatial task
• Awareness of embodiment enhances enjoyment and engages sensorimotor cortices
• Spontaneous Encoding of Event Roles in Hominids
• Investigating Lexical Change through Cross-Linguistic Colexification Patterns
• Where nature is not so green: Exploring perceptions of urban nature in a semi-arid city
• Bayesian Hierarchical Bernoulli-Weibull Mixture Model for Extremely Rare Events
• Animal-borne acoustic biologgers to broaden the applicability of passive acoustic monitoring to terrestrial mammals: a feasibility study for deer
• Density dependence only affects increase rates in baleen whale populations at high abundance levels
• How do linguistic illusions arise? Rational inference and good-enough processing as competing latent processes within individuals
• The role of between-group signaling in the evolution of primate ornamentation
• Predictive models aren't for causal inference
• Planktivorous fishes withstand 20 years of major coral cover oscillations
• Multidimensional Poverty Mapping for Small Areas
• Memory Reactivation during Learning Simultaneously Promotes Dentate Gyrus/CA_2,3Pattern Differentiation and CA₁Memory Integration
• Life-history strategy mediates the effects of multiple developmental stressors on Australian lizards
• Survival and movements of brown‐headed nuthatches after translocation to the Missouri Ozarks
• Variations in Repeated Measures of Cognitive Load and Interest During Complex Learning Tasks
• Emotions and perceptions predict local communities' attitudes toward the conservation of large carnivores
• Chimpanzees rationally revise their beliefs
• Water solubility in silicate melts: The effects of melt composition under reducing conditions and implications for nebular ingassing on rocky planets
• Environment-Aware Indoor LoRaWAN Path Loss: Parametric Regression Comparisons, Shadow Fading, and Calibrated Fade Margins
• regTPS-KLE: A Novel Approach To Approximate A Gaussian Random Field for Bayesian Spatial Modeling
• Spatial Gaussian fields for complex areas with application to marine megafauna conservation
• Functional traits mediate the effect of environmental conditions on tree growth of common Andean trees
• Bayesian Model Comparison and Significance: Widespread Errors and how to Correct Them
• Modeling Spatial Heterogeneity in Exposure Buffers and Risk: A Hierarchical Bayesian Approach
• Consonant lengthening marks the beginning of words across a diverse sample of languages
• Daily torpor reduces the energetic consequences of microhabitat selection for a widespread bat
• Visualization in Bayesian Workflow
• Support or suppress: Father’s parental leave uptake in the private-sector workplace context in Finland
• CRONOSOJA: a daily time-step hierarchical model predicting soybean development across maturity groups in the Southern Cone
• Inter‐ and intraspecific variation in the degree of marine‐derived resources of amphidromous fishes
• Conditional vs marginal estimation of the predictive loss of hierarchical models using WAIC and cross-validation
• Deciphering the correlated evolutionary responses of the hands and feet in modern humans
• Eating disorder presentations to a child and adolescent mental health service in the UK before and during the COVID-19 pandemic
• Colony size as the main driver of the evolution of song diversity and composition in weaverbirds
• Prioritizing fire management goals in a biodiversity hotspot
• Ordinal Regression Models in Psychology: A Tutorial
• Choice- and trial-history effects on causality perception in Schizophrenia Spectrum Disorder
• eDNAjoint: An R package for interpreting paired or semi‐paired environmental <scp>DNA</scp> and traditional survey data in a Bayesian framework
• Intrapersonal emotion regulation training in virtual reality: embodying self-talk
• Towards more appropriate modelling of linguistic complexity measures: Beyond traditional regression models
• End-to-end Bayesian analysis for summarizing sets of radiocarbon dates
• Stock assessment models overstate sustainability of the world’s fisheries
• The dynamics and longevity of circulating CD4+ memory T cells depend on cell age and not the chronological age of the host
• Seismic Tomography 2024
• Documenting and modeling the acoustic variability of intervocalic alveolar taps in conversational Peninsular Spanish
• The performance of Bayesian fit measures in detecting misspecified multilevel structural equation modeling
• BDSAR: a new package on Bregman divergence for Bayesian simultaneous autoregressive models
• Beyond Average Scores: Identification of Consistent and Inconsistent Academic Achievement in Grouping Units
• The application of stable carbon and nitrogen isotopes to assess the feeding ecology of long-finned pilot whales (Globicephala melas) in Scotland
• The ARR2 Prior: Flexible Predictive Prior Definition for Bayesian Auto-Regressions
• Morphological effects in speech reduction are speaker specific and may partly originate from the words’ most frequent phonological context
• Interannual differences in common eider duck exposure to avian influenza viruses at an Arctic colony
• Ecological and social pressures drive same-sex sexual behaviour in non-human primates
• Effects of pelagic longline hook size on species- and size-selectivity and survival
• Breaking the 50+ barrier: Cortical speed of sound via quantitative ultrasound as a new age-at-death estimator in older adults
• Sparsity information and regularization in the horseshoe and other shrinkage priors
• Confidence and gradation in causal judgment
• Integrated population model reveals human- and environment-driven changes in Baltic ringed seal Pusa hispida botnica demography and behavior
• Global status, research priorities, and conservation needs for the manul, a small wild cat of Asia
• Voice patterns in schizophrenia: A systematic review and Bayesian meta-analysis
• Joint estimation of insurance loss development factors using Bayesian hidden Markov models
• An Expert Guide to Planning Experimental Tasks For Evidence-Accumulation Modeling
• A Bayesian framework to investigate radiation reaction in strong fields
• Predicting cognitive function 3 months after surgery in patients with a glioma
• Measuring Mid-2025 LLM-Assistance on Novice Performance in Biology
• Diverging roles of TRPV1 and TRPM2 in warm-temperature detection
• Recasting adaptation as strategy inference
• Modeling Sonority in Terms of Pitch Intelligibility With the Nucleus Attraction Principle
• Hierarchical Bayesian Modelling of Macroeconomic Variables in Ghana
• Advances in Projection Predictive Inference
• <i>Anas platyrhynchos</i> (Mallard) has been replacing <i>Anas rubripes</i> (American Black Duck) in human-altered landscapes in Ontario, 1996 to 2019
• Comparison of visual assessment and quantitative goodness-of-fit metrics on GUTS model fits
• Generalizing Survey Experiments Using Topic Sampling: An Application to Party Cues
• Estimation of introduction and transmission rates of SARS-CoV-2 in a prospective household study
• Ripple effects in a communication network: anti-eavesdropper defence elicits elaborated sexual signals in rival males
• Dependent latent class partial credit models for careless and insufficient effort responding in online survey data
• Data-driven upper bounds and event attribution for unprecedented heatwaves
• Generalized TV–ℓp Structured Priors for Bayesian T1 Mapping
• The levers of political persuasion with conversational artificial intelligence
• Bayesian Analysis of Tuberculosis Cases in Bolgatanga Municipality, Ghana–West Africa
• Explaining the description-experience gap in risky decision-making: learning and memory retention during experience as causal mechanisms
• Human-influenced environmental changes can impact foraging and social behaviour of wild bottlenose dolphins
• Trophic organisation of a large lake fish community: comparing alternative models and evaluating resource use based on stable isotope ratios
• Covariance-Corrected WAIC for Bayesian Sequential Data Models
• On Quantification of Borrowing of Information in Hierarchical Bayesian Models
• Historical and experimental evidence that inherent properties are overweighted in early scientific explanation
• Nitrogen-limitation Overrides Impacts of Wildfire Ash on Primary Production in Naturally Eutrophic, Grassland Lakes
• The Estimation and Projection Package Age-Sex Model and the r-hybrid model
• The longitudinal association between reward processing and symptoms of video game addiction in the Adolescent Brain Cognitive Development Study
• On the probability and direction of morphosyntactic lifespan change
• Bioaccumulation of metals in a critically endangered migratory songbird, the Yellow-breasted Bunting ( <i>Emberiza aureola</i> )
• A Latent Factor Panel Approach to Spatiotemporal Causal Inference
• Network Meta-Analysis of survival outcomes with non-proportional hazards using flexible M-splines
• Resolving the effects of functional traits on tree growth rates: The influence of temporal dynamics and divergent strategies by leaf habit
• Trust perception in Syrian refugee children
• Generative AI and Topological Data Analysis of Longitudinal Panel Data
• Blinded versus Unblinded Review: A Field Study on the Equity of Peer-Review Processes
• Limitations of "Limitations of Bayesian leave-one-out cross-validation for model selection"
• The miseries that remain may yet be alleviated
• Language transfer and positional bias in English stress
• A gentle introduction to Bayesian statistics, with applications to bilingualism research
• Learning from geometry-aware near-misses to real-time COR: A spatiotemporal grouped random GEV framework
• REFINESTAT: Efficient Exploration for Probabilistic Program Synthesis
• Robust Survival Estimation under Interval Censoring: Expectation-Maximization and Bayesian Accelerated Failure Time Assessment via Simulation and Application
• Cognitive computational model reveals repetition bias in a sequential decision-making task
• Evolutionary dynamics of 1,976 lymphoid malignancies predict clinical outcome
• A Bayesian approach to estimate minute ventilation from heart rate during exercise for assessing environmental exposures of females
• Estimating causal effects from panel data with dynamic multivariate panel models
• Large declines in organofluorine contamination indicated by subarctic marine mammal tissues
• To Vary or Not To Vary: A Flexible Empirical Bayes Factor for Testing Variance Components
• A Bayesian Ensemble Projection of Climate Change and Technological Impacts on Future Crop Yields