Generalization guides human exploration in vast decision spaces

2018/11/06 by Charley M. Wu, Eric Schulz, Maarten Speekenbrink +2 · 255 citations
Computer Science · Mathematics · #Advanced Multi-Objective Optimization Algorithms #Artificial intelligence #Bayesian probability #Computer science #Ecology #Foraging #Function (biology) #Gaussian Processes and Bayesian Inference #Generalization #Heuristic #Machine learning #Mathematics #Probabilistic logic #Process (computing) #Reinforcement Learning in Robotics #Space (punctuation) #Thompson sampling

paper · doi:10.1038/s41562-018-0467-4

published in Nature Human Behaviour 2(12), 915-924 (Nature Portfolio)

openalex publication_date 2018/11/06 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/25

Citations

• On a Measure of the Information Provided by an Experiment

Cited by

• Novelty as a drive of human exploration in complex stochastic environments
• Consider the time dimension: theorizing and formalizing sequential media selection
• Semantic knowledge guides innovation and drives cultural evolution
• Testing the convergent validity, domain generality, and temporal stability of selected measures of people’s tendency to explore
• Hebbian dreaming for small datasets
• Building Object-based Causal Programs for Human-like Generalization
• Abstract 3D Perception for Spatial Intelligence in Vision-Language Models
• Individual curiosity modulates exploration in sequential book selection
• Will Scaling Improve Social Simulation with LLMs?
• Active inference on discrete state-spaces: a synthesis
• Fluctuations in Sequential Many-Alternative Decisions Reveal Strategies Beyond Immediate Reward Maximisation
• Adolescent risk-taking in the context of exploration and social influence
• Even if suboptimal, novelty drives human exploration
• Curiosity-driven exploration: foundations in neuroscience and computational modeling
• Fear and promise of the unknown: How losses discourage and promote exploration
• Bayesian Expected Uncertainty Reduction (B-EUR) Model: A Computational Account of What Makes Design Options Worth Trying
• Structured, uncertainty-driven exploration in real-world consumer choice. [europepmc]
• Temporal discounting correlates with directed exploration but not with random exploration. [europepmc]
• Discovery of hierarchical representations for efficient planning. [europepmc]
• Generalizing to generalize: Humans flexibly switch between compositional and conjunctive structures during reinforcement learning. [europepmc]
• Dissociable neural correlates of uncertainty underlie different exploration strategies. [europepmc]
• Efficient Closed-loop Maximization of Carbon Nanotube Growth Rate using Bayesian Optimization. [europepmc]
• Similarities and differences in spatial and non-spatial cognitive maps. [europepmc]
• UNDERSTANDING DOCTOR DECISION MAKING: THE CASE OF DEPRESSION TREATMENT. [europepmc]
• Differential reinforcement encoding along the hippocampal long axis helps resolve the explore-exploit dilemma. [europepmc]
• Balancing exploration and exploitation with information and randomization. [europepmc]
• Active inference on discrete state-spaces: A synthesis. [europepmc]
• Children perform extensive information gathering when it is not costly. [europepmc]
• Human complex exploration strategies are enriched by noradrenaline-modulated heuristics. [europepmc]
• The dynamics of explore-exploit decisions reveal a signal-to-noise mechanism for random exploration. [europepmc]
• Search for solutions, learning, simulation, and choice processes in suicidal behavior. [europepmc]
• Promises and challenges of human computational ethology. [europepmc]
• Mixing memory and desire: How memory reactivation supports deliberative decision-making. [europepmc]
• Asymmetric reinforcement learning facilitates human inference of transitive relations. [europepmc]
• Lower Levels of Directed Exploration and Reflective Thinking Are Associated With Greater Anxiety and Depression. [europepmc]
• Time pressure changes how people explore and respond to uncertainty. [europepmc]
• Humans can navigate complex graph structures acquired during latent learning. [europepmc]
• Exploration heuristics decrease during youth. [europepmc]
• Humans adaptively resolve the explore-exploit dilemma under cognitive constraints: Evidence from a multi-armed bandit task. [europepmc]
• Value-free random exploration is linked to impulsivity. [europepmc]
• Developmental changes in exploration resemble stochastic optimization. [europepmc]