Sensitivity Analysis in Observational Research: Introducing the E-Value
2017/07/10 by Tyler J. VanderWeele, Peng Ding · 175 citations
Mathematics · Economics, Econometrics and Finance · #Advanced Causal Inference Techniques #Statistical Methods and Bayesian Inference #Health Systems, Economic Evaluations, Quality of Life
paper · doi:10.7326/m16-2607
Abstract
Sensitivity analysis is useful in assessing how robust an association is to potential unmeasured or uncontrolled confounding. This article introduces a new measure called the "E-value," which is related to the evidence for causality in observational studies that are potentially subject to confounding. The E-value is defined as the minimum strength of association, on the risk ratio scale, that an unmeasured confounder would need to have with both the treatment and the outcome to fully explain away a specific treatment-outcome association, conditional on the measured covariates. A large E-value implies that considerable unmeasured confounding would be needed to explain away an effect estimate. A small E-value implies little unmeasured confounding would be needed to explain away an effect estimate. The authors propose that in all observational studies intended to produce evidence for causality, the E-value be reported or some other sensitivity analysis be used. They suggest calculating the E-value for both the observed association estimate (after adjustments for measured confounders) and the limit of the confidence interval closest to the null. If this were to become standard practice, the ability of the scientific community to assess evidence from observational studies would improve considerably, and ultimately, science would be strengthened.
Cited by
- Cross-sex Hormones and Acute Cardiovascular Events in Transgender Persons
- Rivaroxaban Is Associated With Higher Rates of Gastrointestinal Bleeding Than Other Direct Oral Anticoagulants
- Microvascular Outcomes in Patients With Diabetes After Bariatric Surgery Versus Usual Care
- Adolescent Cannabis Use and Risk of Psychotic, Bipolar, Depressive, and Anxiety Disorders
- Social participation and incident disability and mortality among frail older adults: A JAGES longitudinal study
- Positive Treatment Effects and High Heterogeneity of Hormonal Contraceptive Use on Women’s Sexuality
- Maternal Acetaminophen Use and Offspring's Neurodevelopmental Outcome: A Nationwide Birth Cohort Study
- Using routinely collected data for research purposes: challenges and mitigation strategies
- Domestic Legitimacy, Coethnics Abroad, and the Shape of the Homeland
- Short-term outcomes of combined neuraxial and general anaesthesia versus general anaesthesia alone for elective open abdominal aortic aneurysm repair: retrospective population-based cohort study†
- Dose-dependent relationship between intra-procedural hypoxaemia or hypocapnia and postoperative delirium in older patients
- Advancing causal inference in ecology: Pathways for biodiversity change detection and attribution
- Impact of postoperative chemotherapy on survival for oesophagogastric adenocarcinoma after preoperative chemotherapy and surgery
- Association of New and Growing Nodules With Malignancy in Follow-Up Screening for Lung Cancer
- The Spatial Determinants of Academic Aspirations: Evidence From Sweden
- Long-term exposure to air pollution and incidence of mental disorders. A large longitudinal cohort study of adults within an urban area
- Impact of childhood traumatic brain injury on educational attainment in Finland from 1998 to 2018: a retrospective register-based nationwide cohort study
- Smoking and COVID-19 outcomes: an observational and Mendelian randomisation study using the UK Biobank cohort
- Preoperative Immuno-Nutrition and Complications After Colorectal Surgery: Results of a 2-Year Prospective Study
- Climate-resilient electric vehicle charging infrastructure for sustainable cities: An interpretable causal-ensemble framework for preventive maintenance and low-carbon mobility
- LLM-Extracted Covariates for Clinical Causal Inference: Rethinking Integration Strategies
- Hypothesis Testing with E-values
- Difference-in-Differences in the Presence of Unknown Interference
- Using the E-Value to Assess the Potential Effect of Unmeasured Confounding in Observational Studies
- Adverse Childhood Experiences (ACEs): What Have We Learned and What's Next?
- Bayesian Sensitivity Analysis for Missing Data Using the E-value
- Vegetarian and vegan diets and cancer incidence: a systematic review and meta-analysis of prospective studies
- An evolved interpretation of Austin Bradford Hill’s causal viewpoints and their influence on epidemiologic methods
- When Algorithms Manage Humans: A Double Machine Learning Approach to Estimating Nonlinear Effects of Algorithmic Control on Gig Worker Performance and Wellbeing
- Frailty is associated with fewer hospital-free days following peripheral artery disease revascularization
- Volunteering and Subsequent Health and Well-Being in Older Adults: An Outcome-Wide Longitudinal Approach
- Routine Blood Biomarkers Reveal a Preclinical Continuum of Multiple Myeloma Risk
- The green dividend of digital finance: The impact of mobile money on solar adoption in Kenya
- Toward New Directions in Human Biology: A Roadmap for Anthropological Causal Inference With Observational Data
- Robustness intervals for competing risks analysis with causes of failure missing not at random
- A sensitivity analysis for non-inferiority studies with non-randomised data
- Effect of reserve protection level and governance on tree cover loss and gain
- A tutorial for propensity score weighting methods under violations of the positivity assumption
- Dissociation between resuscitation success and neurological recovery in nursing home cardiac arrest: A propensity-matched analysis
- Causal Inference About the Effects of Interventions From Observational Studies in Medical Journals
- Comparison of outcomes after living and deceased donor kidney transplantation: UK national cohort study
- Causal Graph Neural Networks for Healthcare
- The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
- Prepregnancy obesity and risk of placental inflammation at term: a selection bias analysis
- Sense of Purpose in Life and Subsequent Physical, Behavioral, and Psychosocial Health: An Outcome-Wide Approach
- Loneliness During Adolescence and Subsequent Health and Well-Being in Adulthood: An Outcome-Wide Longitudinal Approach
- Bidirectional associations between meaning in life and the health, emotional ill-being and daily life functioning outcomes among older adults
- Assessing Impact of Unobserved Confounders with Sensitivity Index Probabilities through Pseudo-Experiments
- Real-world effectiveness of maternal genetically inactivated acellular pertussis vaccination in protecting infants under three months of age: a case-control study using concurrent community-based and test-negative controls
- Intra-articular corticosteroids and the risk of knee osteoarthritis progression: results from the Osteoarthritis Initiative
- Making Sense of Sensitivity: Extending Omitted Variable Bias
- Six‐fold increased risk of acute pancreatitis in alcohol‐related liver disease compared to matched comparators: A population‐based cohort study
- Association between the planetary health diet and sleep health in older adults: findings from a national community-based study
- Healthy plant‐based dietary pattern is associated with a lower risk of rosacea
- Does Meaning in Life Mediate Associations Between Suffering and Subsequent Mental Well‐Being? Longitudinal Evidence From Two Non‐Western Samples
- Associations of Religious Upbringing With Subsequent Health and Well-Being From Adolescence to Young Adulthood: An Outcome-Wide Analysis
- Designing causal mediation analyses to quantify intermediary processes in ecology
- Association of the Mediterranean Dietary Approaches to Stop Hypertension Intervention for Neurodegenerative Delay (MIND) Diet With the Risk of Dementia
- A real-world analysis of the impact of azole antifungal prophylaxis on outcomes in patients with newly diagnosed acute myeloid leukemia treated with venetoclax-based therapy
- The neutrophil-to-lymphocyte ratio is associated with mortality in the general population: The Rotterdam Study
- Effects of Screen-Based Leisure Time on 24 Subsequent Health and Wellbeing Outcomes: A Longitudinal Outcome-Wide Analysis
- Assessing the real-world effectiveness of 8 major metastatic breast cancer drugs using target trial emulation
- Calibrating confounding strength in sensitivity models for weighting estimators: a comparative review and a new method
- Ambient Air Pollution, Cognitive Impairment, and Dementia Among Older Patients Being Evaluated for Kidney Transplantation
- Target Trial Emulation of Empiric Antibiotics on Clinical Outcomes in Moderately Immunocompromised Patients Hospitalized With Pneumonia
- Is Working in College Worth It? How Hours on the Job Affect Postsecondary Outcomes
- Monocyte-to-HDL-cholesterol ratio and 1-year mortality in critically ill coronary heart disease: A MIMIC cohort study
- A hypothetical intervention on the use of hearing aids for the risk of dementia in people with hearing loss in UK Biobank
- Knowing the Facts but Choosing the Shortcut: Understanding How Large Language Models Compare Entities
- Nutrient supplementation for prevention of viral respiratory tract infections in healthy subjects: A systematic review and meta‐analysis
- The Effect of Early College High Schools on STEM Bachelor's Degree Attainment: Evidence from North Carolina
- Social marginalisation, environmental degradation and Toxoplasma gondii exposure in urban informal settlements in Brazil
- Hepatic Events Prevention by Antihyperglycemic Therapies and Intervention Comparisons in Type 2 Diabetes: The HEPATIC-T2DM Network Meta-analysis
- Association of glucagon-like peptide-1 receptor agonists with serious liver events among patients with type 2 diabetes: A Scandinavian cohort study
- Public library visits and later-life health and well-being: evidence from a longitudinal study of older adults in Australia
- Pre‐operative anaemia, red blood cell transfusion and mortality after cardiac surgery: a Netherlands Heart Registration mediation analysis
- Impacts of glucagon‐like peptide‐1 receptor agonists on the risk of adverse liver outcomes in patients with metabolic dysfunction‐associated steatotic liver disease cirrhosis and type 2 diabetes
- Association of the systemic immune inflammation index with failure after core decompression for osteonecrosis of the femoral head: a prospective time-to-event analysis
- Optimal dose of intra‐operative dexmedetomidine for postoperative delirium prevention
- The relationship between cannabis and nicotine use: A systematic review and meta‐analysis
- Onset of exposure to workplace bullying and incident treatment with psychotropic medication – an emulated target trial with 25 309 Swedish and Danish employees
- Nonoperative Versus Neurosurgical Treatment of Brain Abscess: An Emulated Trial Nested Within a Nationwide, Population-Based Cohort
- GLP-1RA and SGLT2i Medications for Type 2 Diabetes and Alzheimer Disease and Related Dementias
- Early Childhood Antibiotics and Chronic Pediatric Conditions: A Retrospective Cohort Study
- Non‐steroidal anti‐inflammatory drugs and risk of kidney cancer: A Swedish nationwide cohort study in the general and high‐use populations
- Impact of Baseline Kidney Function on the Rate of Progressive Kidney Disease After Pregnancy: A Population-Based Cohort Study Research Protocol
- A Double Machine Learning Approach for the Evaluation of COVID‐19 Vaccine Effectiveness Under the Test‐Negative Design: Analysis of Québec Administrative Data
- Statin therapy is associated with better ambulatory blood pressure control: a propensity score analysis
- Longitudinal associations of dispositional forgivingness with multidimensional well-being: a two-wave outcome-wide analysis in the Global Flourishing Study
- Glucagon-Like Peptide 1 Receptor Agonists and Risk of Nonarteritic Anterior Ischemic Optic Neuropathy in Patients With Type 2 Diabetes
- Association Between Malnutrition and Sepsis‐Associated Delirium: A Retrospective Analysis of the MIMIC ‐ IV Database
- Post‐intensive care syndrome after critical illness
- Climate variability and human disturbances as drivers of vegetation health in the riparian zone of the Danube
- Tonsillectomy and immunosuppression improve outcomes in Caucasians with high-risk IgA nephropathy
- Concomitant Psychotropic Medication Is Associated with Reduced Outcomes of Trauma-Focused Psychotherapy for Post-Traumatic Stress Disorder
- GLP-1 receptor agonist use and cancer risk in obese nondiabetic adults
- Effect of social resources on readmission prevention and the influence of informal coercion in acute schizophrenia: a retrospective quasi-experimental cohort study
- Proteomic variation underlies the heterogeneous risk of metabolic dysfunction-associated steatotic liver disease for subsequent chronic diseases
- Dietary index based on the Food Standards Agency nutrient profiling system and risk of Crohn's disease and ulcerative colitis
- Volume and Intensity of Walking and Risk of Chronic Low Back Pain
- Foreign faith and rising state: An examination of state-building dynamics in late 16th-century Japan
- The impact of prenatal alcohol exposure on sleep outcomes in 10,336 young adolescents: An Adolescent Brain Cognitive Development (ABCD) Study
- Childhood predictors of charitable giving and helping across 22 countries in the Global Flourishing Study
- Exploring bidirectional causality between religion and mental health: A longitudinal study using data from the parent generation of a UK birth cohort
- Impact of empiric antibiotics on risk of Clostridioides difficile—a causal inference observational analysis
- Identifying the role of high school in educational inequality: A causal mediation approach
- Polycystic ovary syndrome and its association with reproductive cancers in women
- Legume and soy consumption and the risk of hypertension: a systematic review and dose–response meta-analysis of prospective studies
- Reallocation of time between device-measured movement behaviours and risk of incident cardiovascular disease
- Long-Term Kidney Outcomes after Pediatric Acute Kidney Injury
- Rate doubly robust estimation for weighted average treatment effects
- A Tutorial on Conducting Mediation Analysis with Exposure Mixtures
- Coffee and tea intake, circulating inflammatory biomarkers, and long-term risk of dementia: findings from two longitudinal studies
- Euthanasia rates and risk factors for euthanasia in dogs diagnosed with diabetes mellitus in Australian primary care practices: 2078 cases (2008‐2017)
- Glucagon-Like Peptide-1 Receptor Agonists and Risk of Systemic and Ocular Vascular Complications in Patients With Type 2 Diabetes and Diabetic Retinopathy
- Buprenorphine Adherence Trajectories and Their Impact on Opioid Overdose and Healthcare Costs
- Lower risks of cirrhosis and hepatocellular carcinoma with GLP‐1RAs in type 2 diabetes: A nationwide cohort study using target trial emulation framework
- Sensitivity Analysis to Unobserved Confounding with Copula-based Normalizing Flows
- Major adverse cardiovascular events risk in menopausal women treated with oral estradiol/micronized progesterone versus conjugated estrogens/medroxyprogesterone: a claims data analysis in the USA
- Alcohol use‐specific treatment initiation among patients undergoing surgical procedures: A retrospective cohort analysis
- Incorporating structural uncertainty in causal decision making
- Simple Sensitivity Analysis for Differential Measurement Error
- PROBE 2023 guidelines for reporting observational studies in Endodontics: A consensus‐based development study
- Diabetes mellitus, prediabetes and the risk of Parkinson’s disease: a systematic review and meta-analysis of 15 cohort studies with 29.9 million participants and 86,345 cases
- A New Integrative Learning Framework for Integrating Multiple Secondary Outcomes into Primary Outcome Analysis: A Case Study on Liver Health
- GLP-1s Versus DPP-4s and Risk of Dementia in Patients Requiring Hemodialysis: A Target Trial Emulation Study
- Tissue Kallikrein as a Mediator in Stroke Outcomes among Patients With Metabolic Syndrome: A Multicenter Study Integrating Big Data and Biomarkers
- Inflammatory and Insulinemic Dietary Patterns and Risk of Type 2 Diabetes Among Women With a History of Gestational Diabetes Mellitus: A Prospective Study of 84,174 Person-Years of Follow-up
- Effect of varenicline on major adverse liver outcomes in alcohol‐associated liver disease: An exploratory analysis
- Guidelines for estimating causal effects in pragmatic randomized trials
- Association between sedative prescriptions after hospital discharge and falls and other adverse events in older adults: a population-based cohort study
- Comparative effectiveness of second‐line treatments for epileptic spasms
- Association of the total cholesterol to high-density lipoprotein cholesterol ratio with all-cause mortality risk in the migraine population
- Paternal age and neonatal outcomes: a population-based cohort study
- Instrumented Difference-in-Differences
- Overcoming Data Gaps in Life Course Epidemiology by Matching Across Cohorts
- Bayesian fusion forests for heterogeneous treatment effects on survival from randomised and real-world data
- Bayesian Sensitivity Analysis for Unmeasured Confounding in Causal Panel Data Models
- A 14-year prospective cohort study of type 2 diabetes development in Dutch healthy adults of South Asian origin: risk factors and the association with metabolic syndrome and HOMA-IR
- Clonal hematopoiesis of indeterminate potential and risk of immune thrombocytopenia
- Sensitivity Analysis for Publication Bias in Meta-Analyses
- Air pollution and COVID-19 mortality in the United States: Strengths and limitations of an ecological regression analysis
- Methamphetamine exposure and depression—A systematic review and meta‐analysis
- Cardio-kidney outcomes for combined versus monotherapy with finerenone or SGLT2 inhibitors in patients with CKD
- Discriminating Myalgic Encephalomyelitis/Chronic Fatigue Syndrome and comorbid conditions using metabolomics in UK Biobank
- Street network connectivity leads to denser urban form in Canadian cities
- Impact of Perioperative Pulmonary Artery Catheter Use on Clinical Outcomes After Cardiac Surgery
- Adverse effects of progestin-primed ovarian stimulation: combination of clinical study and single-cell analysis
- Principles of confounder selection
- Religious Communities and Human Flourishing
- Web Site and R Package for Computing E-values. [europepmc]
- Medication for Opioid Use Disorder After Nonfatal Opioid Overdose and Association With Mortality: A Cohort Study. [europepmc]
- Cross-sex Hormones and Acute Cardiovascular Events in Transgender Persons: A Cohort Study. [europepmc]
- SOME DESIRABLE PROPERTIES OF THE BONFERRONI CORRECTION: IS THE BONFERRONI CORRECTION REALLY SO BAD? [europepmc]
- Association of Primary Care Physician Supply With Population Mortality in the United States, 2005-2015. [europepmc]
- Principles of confounder selection. [europepmc]
- Association between consumption of ultra-processed foods and all cause mortality: SUN prospective cohort study. [europepmc]
- Association of Metabolic Surgery With Major Adverse Cardiovascular Outcomes in Patients With Type 2 Diabetes and Obesity. [europepmc]
- Association Between Recreational Marijuana Legalization in the United States and Changes in Marijuana Use and Cannabis Use Disorder From 2008 to 2016. [europepmc]
- Association of Inpatient Use of Angiotensin-Converting Enzyme Inhibitors and Angiotensin II Receptor Blockers With Mortality Among Patients With Hypertension Hospitalized With COVID-19. [europepmc]
- Association of Blood Glucose Control and Outcomes in Patients with COVID-19 and Pre-existing Type 2 Diabetes. [europepmc]
- Association of Treatment With Hydroxychloroquine or Azithromycin With In-Hospital Mortality in Patients With COVID-19 in New York State. [europepmc]
- In-Hospital Use of Statins Is Associated with a Reduced Risk of Mortality among Individuals with COVID-19. [europepmc]
- Long-term exposure to NO 2 and O 3 and all-cause and respiratory mortality: A systematic review and meta-analysis. [europepmc]
- Air pollution and COVID-19 mortality in the United States: Strengths and limitations of an ecological regression analysis. [europepmc]
- Intraoperative Hypotension Is Associated With Adverse Clinical Outcomes After Noncardiac Surgery. [europepmc]
- Arterial events, venous thromboembolism, thrombocytopenia, and bleeding after vaccination with Oxford-AstraZeneca ChAdOx1-S in Denmark and Norway: population based cohort study. [europepmc]
- Multisystem Inflammatory Syndrome in Children - Initial Therapy and Outcomes. [europepmc]
- Mental disorders and risk of COVID-19-related mortality, hospitalisation, and intensive care unit admission: a systematic review and meta-analysis. [europepmc]
- Strengthening the reporting of observational studies in epidemiology using mendelian randomisation (STROBE-MR): explanation and elaboration. [europepmc]
- Association of Bariatric Surgery With Major Adverse Liver and Cardiovascular Outcomes in Patients With Biopsy-Proven Nonalcoholic Steatohepatitis. [europepmc]
- Immune correlates analysis of the mRNA-1273 COVID-19 vaccine efficacy clinical trial. [europepmc]
- Mental Health Outcomes in Transgender and Nonbinary Youths Receiving Gender-Affirming Care. [europepmc]
- Association of Bariatric Surgery With Cancer Risk and Mortality in Adults With Obesity. [europepmc]
- A real-world comparison of tisagenlecleucel and axicabtagene ciloleucel CAR T cells in relapsed or refractory diffuse large B cell lymphoma. [europepmc]
Related