Trust in Automation
2014/09/02 by Kevin Anthony Hoff, Kevin A. Hoff, Masooda Bashir · 2,569 citations
Decision Sciences · Engineering · Psychology · #Artificial intelligence #Automation #Cognitive Functions and Memory #Computer science #Data science #Empirical research #Engineering #Human-Automation Interaction and Safety #Internet privacy #Knowledge management #Personal Information Management and User Behavior #Psychology #Situation awareness #Situational ethics #Social psychology #Trustworthiness #Variety (cybernetics)
paper · doi:10.1177/0018720814547570
published in Human Factors The Journal of the Human Factors and Ergonomics Society 57(3), 407-434 (SAGE Publishing)
openalex publication_date 2014/09/02 · openalex created_date 2016/06/24 · openalex updated_date 2026/08/05
Abstract
OBJECTIVE: We systematically review recent empirical research on factors that influence trust in automation to present a three-layered trust model that synthesizes existing knowledge. BACKGROUND: Much of the existing research on factors that guide human-automation interaction is centered around trust, a variable that often determines the willingness of human operators to rely on automation. Studies have utilized a variety of different automated systems in diverse experimental paradigms to identify factors that impact operators' trust. METHOD: We performed a systematic review of empirical research on trust in automation from January 2002 to June 2013. Papers were deemed eligible only if they reported the results of a human-subjects experiment in which humans interacted with an automated system in order to achieve a goal. Additionally, a relationship between trust (or a trust-related behavior) and another variable had to be measured. All together, 101 total papers, containing 127 eligible studies, were included in the review. RESULTS: Our analysis revealed three layers of variability in human-automation trust (dispositional trust, situational trust, and learned trust), which we organize into a model. We propose design recommendations for creating trustworthy automation and identify environmental conditions that can affect the strength of the relationship between trust and reliance. Future research directions are also discussed for each layer of trust. CONCLUSION: Our three-layered trust model provides a new lens for conceptualizing the variability of trust in automation. Its structure can be applied to help guide future research and develop training interventions and design procedures that encourage appropriate trust.
Citations
Cited by
- Trusting Automation: Designing for Responsivity and Resilience
- A Meta-Analysis of Factors Influencing the Development of Trust in Automation
- The More You Know: Trust Dynamics and Calibration in Highly Automated Driving and the Effects of Take-Overs, System Malfunction, and System Transparency
- Prior Familiarization With Takeover Requests Affects Drivers’ Takeover Performance and Automation Trust
- “Oops! That was my fault, I am so sorry for sudden braking”: using voice assistants to repair trust after automated driving failures
- Disuse of advanced driver assistance systems (ADAS)
- Meaningful Communication but not Superficial Anthropomorphism Facilitates Human-Automation Trust Calibration: The Human-Automation Trust Expectation Model (HATEM)
- Keep Your Scanners Peeled
- Calibration of Trust in Automated Driving: A Matter of Initial Level of Trust and Automated Driving Style?
- Developing and Validating the Spanish Version of the Large Language Models Dependency Scale (LLM-D12-SP)
- Smart Tech is all Around us – Bridging Employee Vulnerability with Organizational Active Trust‐Building
- Female chatbots are helpful, male chatbots are competent?
- To trust or not to trust? An assessment of trust in AI-based systems: Concerns, ethics and contexts
- Unveiling the Mind of the Machine
- Human-in-the-Loop User Feedback Affects Perceived Accuracy and Trust, but Task Subjectivity Matters
- Can AR Embedded Visualizations Foster Appropriate Reliance on AI in Spatial Decision-Making? A Comparative Study of AR X-Ray vs. 2D Minimap
- Towards a Conversational Measure of Trust
- The LLM Fallacy: Misattribution in AI-Assisted Cognitive Workflows
- The care-full craft of feedback in an age of generative AI
- Repairing Human Trust by Promptly Correcting Robot Mistakes with An Attention Transfer Model
- Trust and reliance on AI — An experimental study on the extent and costs of overreliance on AI
- The Trust in AI-Generated Health Advice (TAIGHA) Scale and Short Version (TAIGHA-S): Development and Validation Study
- The role of critical thinking on undergraduates' reliance behaviours on generative AI in problem‐solving
- The role of intelligence, trust and interpersonal job characteristics in employees’ AI usage acceptance
- Autonomous Vehicles Drive into Shared Spaces: eHMI Design Concept Focusing on Vulnerable Road Users
- Trust as a mediator between physical climate conditions and human–robot collaboration efficiency in construction
- Medical robotics beyond automation: Human-robot collaboration and the RONNA system as a socio-technical case study
- Opportunity Versus Threat Appraisals of AI Aids: The Effect of Appraisal Type on Decision Makers' Effort and Compliance When Using Powerful AI Aids
- The Paradox of Algorithms and Blame on Public Decision-makers
- Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
- Skybound Magic: Enabling Body-Only Drone Piloting Through a Lightweight Vision–Pose Interaction Framework
- Regulating for trust: Can law establish trust in artificial intelligence?
- Trusting emotional support from generative artificial intelligence: a conceptual review
- Potential for Harm and Privacy Are Top AI Ethics Concerns: Evidence From a Representative UK Survey
- Ethics and Governance of Artificial Intelligence: Evidence from a Survey of Machine Learning Researchers
- When Algorithms Err : Differential Impact of Early vs. Late Errors on Users’ Reliance on Algorithms
- Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAI
- In Generative AI We (Dis)Trust? Computational Analysis of Trust and Distrust in Reddit Discussions
- Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Survey
- Human Trust in Artificial Intelligence: Review of Empirical Research
- Enhancing autonomy transparency: an option-centric rationale approach
- From Mass Media and Social Media to AI: A Multilevel Framework for Understanding Trust in Generative AI
- Designing Intent Communication for Agent-Human Collaboration
- R-AI-diographers: a European survey on perceived impact of AI on professional identity, careers, and radiographers’ roles
- The Formation of Trust in Autonomous Vehicles after Interacting with Robotaxis on Public Roads
- Embedding artificial intelligence in society: looking beyond the EU AI master plan using the culture cycle
- Trust in artificial intelligence: a survey experiment to assess trust in algorithmic decision-making
- Trust in Collaborative Automation in High Stakes Software Engineering Work: A Case Study at NASA
- “It Became My Buddy, But I’m Not Afraid to Disagree”: A Multi-Session Study of UX Evaluators Collaborating with Conversational AI Assistants
- A Review on Trust in Human-Robot Interaction
- AI Error Difficulty Modulates the Effectiveness of Explainability in Decision Support Systems
- Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration
- Measuring Large Language Models Dependency: Validating the Arabic Version of the LLM-D12 Scale
- Twenty-four years of empirical research on trust in AI: a bibliometric review of trends, overlooked issues, and future directions
- Trustworthy Transparency by Design
- In AI We Trust? Factors That Influence Trustworthiness of AI-infused Decision-Making Processes
- Trust and trustworthy artificial intelligence: A research agenda for AI in the environmental sciences
- Why not both? Complementing explanations with uncertainty, and self-confidence in human-AI collaboration
- BreastScreening-AI: Evaluating medical intelligent agents for human-AI interactions
- Exploring a biocentric LLM-based assistant in environmental decision-making with more-than-human representation of the Tagus Estuary
- Towards Transparent Ethical AI: A Roadmap for Trustworthy Robotic Systems
- To pass or not to pass: a field experiment on human values in interactions with automated vehicles
- Trust in AI and Its Role in the Acceptance of AI Technologies
- Integrating Transparency, Trust, and Acceptance: The Intelligent Systems Technology Acceptance Model (ISTAM)
- Trust in Automation (TiA): Simulation Model, and Empirical Findings in Supervisory Control of Maritime Autonomous Surface Ships (MASS)
- Ties of Trust: a bowtie model to uncover trustor-trustee relationships in LLMs
- Grand challenges for human factors and ergonomics
- Unveiling trust in AI: the interplay of antecedents, consequences, and cultural dynamics
- Modeling and Predicting Trust Dynamics in Human-Robot Teaming: A Bayesian Inference Approach
- The political viability of AI on the battlefield: Examining US public support, trust, and blame dynamics
- How can design help enhance trust calibration in public autonomous vehicles?
- Gap the (Theory of) Mind: Sharing Beliefs About Teammates' Goals Boosts Collaboration Perception, Not Performance
- Principles of Explanation in Human-AI Systems
- Trust and perceived risk: How different manifestations affect the adoption of autonomous vehicles
- Do people rely on ChatGPT more than their peers to detect deepfake news?
- Calibrating workers’ trust in intelligent automated systems
- Developing and Integrating Trust Modeling into Multi-Objective Reinforcement Learning for Intelligent Agricultural Management
- An empirical investigation on consumers’ intentions towards autonomous driving
- In Automation We Trust: Investigating the Role of Uncertainty in Active Learning Systems
- Modeling Dispositional and Initial learned Trust in Automated Vehicles with Predictability and Explainability
- Theoretical, Measured, and Subjective Responsibility in Aided Decision Making
- Designing Trustworthy User Interfaces
- Impacts of Personal Characteristics on User Trust in Conversational Recommender Systems
- The Mediating Effects of Emotions on Trust through Risk Perception and System Performance in Automated Driving
- Beyond the code: The impact of AI algorithm transparency signaling on user trust and relational satisfaction
- Virtual Collaborative Analysis: Effects of Two AI Summarizers
- To trust or not to trust a human(-like) AI—A scoping review and conjoint analyses on factors influencing anthropomorphism and trust
- Making AI Accessible for STEM Teachers: Using Explainable AI for Unpacking Classroom Discourse Analysis
- A Little Anthropomorphism Goes a Long Way. [europepmc]
- Automation Expectation Mismatch: Incorrect Prediction Despite Eyes on Threat and Hands on Wheel. [europepmc]
- Communicating Intent of Automated Vehicles to Pedestrians. [europepmc]
- Learning From the Slips of Others: Neural Correlates of Trust in Automated Agents. [europepmc]
- Trust and distrust in information systems at the workplace. [europepmc]
- On the future of transportation in an era of automated and autonomous vehicles. [europepmc]
- Trusting Robocop: Gender-Based Effects on Trust of an Autonomous Robot. [europepmc]
- Individual Differences in Attributes of Trust in Automation: Measurement and Application to System Design. [europepmc]
- Scared to Trust? - Predicting Trust in Highly Automated Driving by Depressiveness, Negative Self-Evaluations and State Anxiety. [europepmc]
- The Challenges of Partially Automated Driving. [europepmc]
- The effects of personality and locus of control on trust in humans versus artificial intelligence. [europepmc]
- Trust Toward Robots and Artificial Intelligence: An Experimental Approach to Human-Technology Interactions Online. [europepmc]
- Developing Self-Awareness in Robots via Inner Speech. [europepmc]
- More Than a Feeling-Interrelation of Trust Layers in Human-Robot Interaction and the Role of User Dispositions and State Anxiety. [europepmc]
- Human-Autonomy Teaming: Definitions, Debates, and Directions. [europepmc]
- Measurement of Trust in Automation: A Narrative Review and Reference Guide. [europepmc]
- A Clinical Decision Support System for Sleep Staging Tasks With Explanations From Artificial Intelligence: User-Centered Design and Evaluation Study. [europepmc]
- Human Factors Considerations and Metrics in Shared Space Human-Robot Collaboration: A Systematic Review. [europepmc]
- Determinants of Laypersons' Trust in Medical Decision Aids: Randomized Controlled Trial. [europepmc]
- Supporting Cognition With Modern Technology: Distributed Cognition Today and in an AI-Enhanced Future. [europepmc]
- Promoting Healthcare Workers' Adoption Intention of Artificial-Intelligence-Assisted Diagnosis and Treatment: The Chain Mediation of Social Influence and Human-Computer Trust. [europepmc]
- An integrative review on the acceptance of artificial intelligence among healthcare professionals in hospitals. [europepmc]
- Trust criteria for artificial intelligence in health: normative and epistemic considerations. [europepmc]
- Grand Challenges in Neurotechnology and System Neuroergonomics. [europepmc]
- Developing trustworthy artificial intelligence: insights from research on interpersonal, human-automation, and human-AI trust. [europepmc]
Related