A sharper Bonferroni procedure for multiple tests of significance
1988/01/01 by YOSEF HOCHBERG, Yosef Hochberg · 4,754 citations
Decision Sciences · Mathematics · #Bonferroni correction #Computer science #Library science #Mathematics #Multiple comparisons problem #Optimal Experimental Design Methods #Statistical Methods and Bayesian Inference #Statistical Methods in Clinical Trials #Statistical significance #Statistics #Tel aviv
paper · doi:10.1093/biomet/75.4.800
published in Biometrika 75(4), 800-802 (Oxford University Press)
openalex publication_date 1988/01/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01
Abstract
A simple procedure for multiple tests of significance based on individual p-values is derived. This simple procedure is sharper than Holm's (1979) sequentially rejective procedure. Both procedures contrast the ordered p- values with the same set of critical values. Holm's procedure rejects an hypothesis only if its p-value and each of the smaller p-values are less than their corresponding critical-values. The new procedure rejects all hypotheses with smaller or equal p-values to that of any one found less than its critical value.
Cited by
- The influence of emotion regulation strategies and sleep quality on depression and anxiety
- Ranibizumab for Neovascular Age-Related Macular Degeneration
- Ranibizumab versus Verteporfin for Neovascular Age-Related Macular Degeneration
- In-Center Hemodialysis Six Times per Week versus Three Times per Week
- Sinecatechins, a Defined Green Tea Extract, in the Treatment of External Anogenital Warts
- Salience and central executive networks track overgeneralization of conditioned-fear in post-traumatic stress disorder
- Controlling the False Discovery Rate: A New Application to Account for Multiple and Dependent Tests in Local Statistics of Spatial Association
- Cranial morphology of Javanese Homo erectus: New evidence for continuous evolution, specialization, and terminal extinction
- The Impacts of International Migration on Remaining Household Members: Omnibus Results from a Migration Lottery Program
- A new criterion for assessing discriminant validity in variance-based structural equation modeling
- Optimal multiple testing under family-wise error control: elementary symmetric polynomials and a scalable algorithm
- Replicability Analysis for Natural Language Processing: Testing Significance with Multiple Datasets
- Factors Associated With Suicide Attempts in 648 Patients With Bipolar Disorder in the Stanley Foundation Bipolar Network
- Efficient and scalable clustering of survival curves
- Dissecting the roles of local packing density and longer-range effects in protein sequence evolution
- Improved Multiple Confidence Intervals via Thresholding Informed by Prior Information
- Asymptotics of higher criticism via Gaussian approximation
- Global and Local Two-Sample Tests via Regression
- A Minimum Description Length Approach to Multitask Feature Selection
- Issues in applied statistics for public health bioterrorism surveillance using multiple data streams: research needs
- Unconsciously learning task-irrelevant perceptual sequences
- Randomized trial of delta-9-tetrahydrocannabinol (THC) versus placebo to augment the effects of prolonged exposure therapy on fear extinction learning in post-traumatic stress disorder: Study rationale and protocol
- Multiplicity Considerations in the Design and Analysis of Clinical Trials
- Fundamental Limits of Exact Support Recovery in High Dimensions
- Penalized Cox’s proportional hazards model for high-dimensional survival data with grouped predictors
- Forest Age Influences Oak Insect Herbivore Community Structure, Richness, And Density
- Measuring Aggregated and Specific Combat Exposures: Associations Between Combat Exposure Measures and Posttraumatic Stress Disorder, Depression, and Alcohol‐Related Problems
- Latent Profile Analysis of Moral Foundations: Emotional and Decisional Forgiveness Approaches to Models of Morality
- Artificial Intelligence and Radiologist Burnout
- Neural correlates of habituation to taste stimuli in healthy women
- SynthID-Image: Image watermarking at internet scale
- Recalled childhood trauma and post-psychedelic trajectories of change in a mixed-methods study
- Bound on FWER for correlated normal distribution
- On Stepwise Control of the Generalized Familywise Error Rate
- Online control of the familywise error rate
- Use and misuse of corrections for multiple testing
- Forecast evaluation for data scientists: common pitfalls and best practices
- Statistical Inference Leveraging Synthetic Data with Distribution-Free Guarantees
- Beware of counter-intuitive levels of false discoveries in datasets with strong intra-correlations
- Prevalence of problematic Internet use and problematic gaming in Spanish adolescents
- Frailty trajectories after a cardiovascular event among community-dwelling older people
- Ivermectin converts cold tumors hot and synergizes with immune checkpoint blockade for treatment of breast cancer
- Genetic structure of theKuwaiti population revealed by paternal lineages
- Radiotherapy versus imiquimod for complex lentigo maligna: A phase 3 randomized clinical trial
- Environmental structure of the graptolite morphospace
- Familywise Error Rate Control via Knockoffs
- Confidence Bands for Impulse Responses: Bonferroni vs. Wald
- Adaptive Frequency Band Analysis for Functional Time Series
- Two step multiple comparisons procedures for positively dependent data with application to detecting differences in human brain network topologies
- Beyond Bonferroni: Hierarchical Multiple Testing in Empirical Research
- Color and emotion: effects of hue, saturation, and brightness
- Substance use Trajectories from Early Adolescence to Emerging Adulthood: A Comparison of Smoking, Binge Drinking, and Marijuana use
- On optimality of Bayesian testimation in the normal means problem
- A Rademacher Complexity Based Method fo rControlling Power and Confidence Level in Adaptive Statistical Analysis
- ANCOVA: A heteroscedastic global test when there is curvature and two covariates
- Multiple testing with persistent homology
- Adaptive multicenter designs for continuous response clinical trials in the presence of an unknown sensitive subgroup
- Geospatial Clustering of 9–1–1 Responses for Pediatric Firearm Injuries Over Time
- The control of the false discovery rate in multiple testing under dependency
- CTDGSI: A comprehensive exploitation of instance selection methods for automatic text classification. VII Concurso de Teses, Dissertações e Trabalhos de Graduação em SI -- XXI Simpósio Brasileiro de Sistemas de Informação
- Robust domain selection for functional data via interval-wise testing and effect size mapping
- How Problematic are Suspenseful Interactions?
- Overweight in children is associated with arterial endothelial dysfunction and intima-media thickening
- False Discovery Rate Computation: Illustrations and Modifications
- The role of frequency in the acquisition of English word order
- Efficient statistical analysis of large correlated multivariate datasets: a case study on brain connectivity matrices
- scikit-covtest: Covariance Matrix Hypothesis Testing in Python
- Compound p-Value Statistics for Multiple Testing Procedures
- Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects
- Terrorist Attacks and Trust in Institutions: Micro Evidence From Europe
- Two-directional simultaneous inference for high-dimensional models
- Bayesian Nonparametric Variable Selection as an Exploratory Tool for Finding Genes that Matter
- Individual-based assessment of population structure and admixture in Austrian, Croatian and German draught horses
- Generalizing Simes’ test and Hochberg’s stepup procedure
- Kendall’s tau in high-dimensional genomic parsimony
- Group sequential Holm and Hochberg procedures
- Can secure habits counter phishing? An exploration using a novel in-tray simulation
- Effectiveness of Antipsychotic Drugs in Patients with Chronic Schizophrenia
- Family Interactions in Children With and Without ADHD
- Decision theory results for one-sided multiple comparison procedures
- Characterization of Bayes procedures for multiple endpoint problems and inadmissibility of the step-up procedure
- Potassium oxalate mouthrinse reduces dentinal hypersensitivity
- Effectiveness of Atypical Antipsychotic Drugs in Patients with Alzheimer's Disease
- Call combinations in wild chimpanzees
- Isosporiasis in patients with HIV infection in the highly active antiretroviral therapy era in France
- Romosozumab or Alendronate for Fracture Prevention in Women with Osteoporosis
- Identification and analysis of functional elements in 1% of the human genome by the ENCODE pilot project
- Deepwater Demersal Fish Community Collapse in Lake Huron
- Male and female pups of the highly sexually dimorphic northern elephant seal (Mirounga angustirostris) differ slightly in body size
- Just-in-Time Catching Test Generation at Meta
- Turkish Cypriot paternal lineages bear an autochthonous character and closest resemblance to those from neighbouring Near Eastern populations
- Correction of the significance level when attempting multiple transformations of an explanatory variable in generalized linear models
- Survival trees based on heterogeneity in time‐to‐event and censoring distributions using parameter instability test
- Bayesian Genome- and Epigenome-Wide Association Studies with Gene Level Dependence
- Efficacy and tolerability of sumatriptan tablets in a fast-disintegrating, rapid-release formulation for the acute treatment of migraine: Results of a multicenter, randomized, placebo-controlled study
- FACT: Fast closed testing for exchangeable local tests
- Information-based inference for singular models and finite sample sizes: A frequentist information criterion
- Push and Pull Search Embedded in an M2M Framework for Solving Constrained Multi-objective Optimization Problems
- Population genetics of 17 Y-STR markers in West Libya (Tripoli region)
- High rates of infidelity in the Grey Fantail Rhipidura albiscapa suggest that testis size may be a better correlate of extra‐pair paternity than sexual dimorphism
- Statistical computation methods for microbiome compositional data network inference
- Training dogs with help of the shock collar: short and long term behavioural effects
- Post-Hoc Trajectory-Risk Certification for Modular LLM-Based Security Agents
- Stepup procedures controlling generalized FWER and generalized FDR
- A glimpse at the intricate mosaic of ethnicities from Mesopotamia: Paternal lineages of the Northern Iraqi Arabs, Kurds, Syriacs, Turkmens and Yazidis
- Yosef Hochberg [wikipedia]
- miRNAs in lung cancer - studying complex fingerprints in patient's blood cells by microarray experiments. [europepmc]
- High-throughput miRNA profiling of human melanoma blood samples. [europepmc]
- Identification of Lactobacillus plantarum genes modulating the cytokine response of human peripheral blood mononuclear cells. [europepmc]
- Cryptic multiple hypotheses testing in linear models: overestimated effect sizes and the winner's curse. [europepmc]
- Detecting moderator effects using subgroup analyses. [europepmc]
- Validation of the theoretical domains framework for use in behaviour change and implementation research. [europepmc]
- Efficacy and safety of enzyme replacement therapy with BMN 110 (elosulfase alfa) for Morquio A syndrome (mucopolysaccharidosis IVA): a phase 3 randomised placebo-controlled study. [europepmc]
- Odanacatib for the treatment of postmenopausal osteoporosis: development history and design and participant characteristics of LOFT, the Long-Term Odanacatib Fracture Trial. [europepmc]
- Hidden multiplicity in exploratory multiway ANOVA: Prevalence and remedies. [europepmc]
- Host species identity, site and time drive temperate tree phyllosphere bacterial community structure. [europepmc]
- Protection against Plasmodium falciparum malaria by PfSPZ Vaccine. [europepmc]
- Safety and Efficacy of Remote Ischemic Preconditioning in Patients With Severe Carotid Artery Stenosis Before Carotid Artery Stenting: A Proof-of-Concept, Randomized Controlled Trial. [europepmc]
- Using Smartphones and Health Apps to Change and Manage Health Behaviors: A Population-Based Survey. [europepmc]
- Effect of Bevacizumab vs Aflibercept on Visual Acuity Among Patients With Macular Edema Due to Central Retinal Vein Occlusion: The SCORE2 Randomized Clinical Trial. [europepmc]
- A general introduction to adjustment for multiple comparisons. [europepmc]
- Psychometric assessment of three newly developed implementation outcome measures. [europepmc]
- Effect of Individualized vs Standard Blood Pressure Management Strategies on Postoperative Organ Dysfunction Among High-Risk Patients Undergoing Major Surgery: A Randomized Clinical Trial. [europepmc]
- Design of the PF-ILD trial: a double-blind, randomised, placebo-controlled phase III trial of nintedanib in patients with progressive fibrosing interstitial lung disease. [europepmc]
- Persistent Macular Thickening Following Intravitreous Aflibercept, Bevacizumab, or Ranibizumab for Central-Involved Diabetic Macular Edema With Vision Impairment: A Secondary Analysis of a Randomized Clinical Trial. [europepmc]
- Viral Diversity of House Mice in New York City. [europepmc]
- Effect of Initial Management With Aflibercept vs Laser Photocoagulation vs Observation on Vision Loss Among Patients With Diabetic Macular Edema Involving the Center of the Macula and Good Visual Acuity: A Randomized Clinical Trial. [europepmc]
- Estimation of a significance threshold for genome-wide association studies. [europepmc]
- Dose-Ranging Effect of Adjunctive Oral Cannabidiol vs Placebo on Convulsive Seizure Frequency in Dravet Syndrome: A Randomized Clinical Trial. [europepmc]
- Comparing Different Statistical Models and Multiple Testing Corrections for Association Mapping in Soybean and Maize. [europepmc]
- Comparison of an Artificial Intelligence-Enabled Patient Decision Aid vs Educational Material on Decision Quality, Shared Decision-Making, Patient Experience, and Functional Outcomes in Adults With Knee Osteoarthritis: A Randomized Clinical Trial. [europepmc]
Related