2014/07/16 by Volker H. Franz, Franz, Volker H., Ulrike von Luxburg +1
Biochemistry, Genetics and Molecular Biology · Computer Science · Mathematics · Psychology · #Adversarial Robustness in Machine Learning #Applications (stat.AP) #Deception detection and forensic psychology #FOS: Biological sciences #FOS: Computer and information sciences #Neurons and Cognition (q-bio.NC) #Psychopathy, Forensic Psychiatry, Sexual Offending #q-bio.NC #stat.AP
paper · pdf · doi:10.48550/arxiv.1407.4240
arxiv created 2014/07/16 · openalex publication_date 2014/07/16 · arxiv updated 2014/07/17 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Neuroscientists frequently use a certain statistical reasoning to establish the existence of distinct neuronal processes in the brain. We show that this reasoning is flawed and that the large corresponding literature needs reconsideration. We illustrate the fallacy with a recent study that received an enormous press coverage because it concluded that humans detect deceit better if they use unconscious processes instead of conscious deliberations. The study was published under a new open-data policy that enabled us to reanalyze the data with more appropriate methods. We found that unconscious performance was close to chance - just as the conscious performance. This illustrates the flaws of this widely used statistical reasoning, the benefits of open-data practices, and the need for careful reconsideration of studies using the same rationale.