Trust in Automation
2014/09/02 by Kevin Anthony Hoff, Kevin A. Hoff, Masooda Bashir · 85 citations
Psychology · Decision Sciences · #Human-Automation Interaction and Safety #Cognitive Functions and Memory #Personal Information Management and User Behavior
paper · doi:10.1177/0018720814547570
Abstract
OBJECTIVE: We systematically review recent empirical research on factors that influence trust in automation to present a three-layered trust model that synthesizes existing knowledge. BACKGROUND: Much of the existing research on factors that guide human-automation interaction is centered around trust, a variable that often determines the willingness of human operators to rely on automation. Studies have utilized a variety of different automated systems in diverse experimental paradigms to identify factors that impact operators' trust. METHOD: We performed a systematic review of empirical research on trust in automation from January 2002 to June 2013. Papers were deemed eligible only if they reported the results of a human-subjects experiment in which humans interacted with an automated system in order to achieve a goal. Additionally, a relationship between trust (or a trust-related behavior) and another variable had to be measured. All together, 101 total papers, containing 127 eligible studies, were included in the review. RESULTS: Our analysis revealed three layers of variability in human-automation trust (dispositional trust, situational trust, and learned trust), which we organize into a model. We propose design recommendations for creating trustworthy automation and identify environmental conditions that can affect the strength of the relationship between trust and reliance. Future research directions are also discussed for each layer of trust. CONCLUSION: Our three-layered trust model provides a new lens for conceptualizing the variability of trust in automation. Its structure can be applied to help guide future research and develop training interventions and design procedures that encourage appropriate trust.
Citations
Cited by
- Trusting Automation: Designing for Responsivity and Resilience
- A Meta-Analysis of Factors Influencing the Development of Trust in Automation
- The More You Know: Trust Dynamics and Calibration in Highly Automated Driving and the Effects of Take-Overs, System Malfunction, and System Transparency
- Prior Familiarization With Takeover Requests Affects Drivers’ Takeover Performance and Automation Trust
- “Oops! That was my fault, I am so sorry for sudden braking”: using voice assistants to repair trust after automated driving failures
- Disuse of advanced driver assistance systems (ADAS)
- Meaningful Communication but not Superficial Anthropomorphism Facilitates Human-Automation Trust Calibration: The Human-Automation Trust Expectation Model (HATEM)
- Keep Your Scanners Peeled
- Calibration of Trust in Automated Driving: A Matter of Initial Level of Trust and Automated Driving Style?
- Developing and Validating the Spanish Version of the Large Language Models Dependency Scale (LLM-D12-SP)
- Smart Tech is all Around us – Bridging Employee Vulnerability with Organizational Active <scp>Trust‐Building</scp>
- Female chatbots are helpful, male chatbots are competent?
- To trust or not to trust? An assessment of trust in AI-based systems: Concerns, ethics and contexts
- Unveiling the Mind of the Machine
- Human-in-the-Loop User Feedback Affects Perceived Accuracy and Trust, but Task Subjectivity Matters
- Can AR Embedded Visualizations Foster Appropriate Reliance on AI in Spatial Decision-Making? A Comparative Study of AR X-Ray vs. 2D Minimap
- Towards a Conversational Measure of Trust
- The LLM Fallacy: Misattribution in AI-Assisted Cognitive Workflows
- The care-full craft of feedback in an age of generative AI
- Repairing Human Trust by Promptly Correcting Robot Mistakes with An Attention Transfer Model
- Trust and reliance on AI — An experimental study on the extent and costs of overreliance on AI
- The Trust in AI-Generated Health Advice (TAIGHA) Scale and Short Version (TAIGHA-S): Development and Validation Study
- The role of critical thinking on undergraduates' reliance behaviours on generative <scp>AI</scp> in problem‐solving
- The role of intelligence, trust and interpersonal job characteristics in employees’ AI usage acceptance
- Autonomous Vehicles Drive into Shared Spaces: EHMI Design Concept Focusing on Vulnerable Road Users
- Trust as a mediator between physical climate conditions and human–robot collaboration efficiency in construction
- Medical robotics beyond automation: Human-robot collaboration and the RONNA system as a socio-technical case study
- Opportunity Versus Threat Appraisals of AI Aids: The Effect of Appraisal Type on Decision Makers' Effort and Compliance When Using Powerful AI Aids
- The Paradox of Algorithms and Blame on Public Decision-makers
- Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
- Skybound Magic: Enabling Body-Only Drone Piloting Through a Lightweight Vision–Pose Interaction Framework
- Regulating for trust: Can law establish trust in artificial intelligence?
- Trusting emotional support from generative artificial intelligence: a conceptual review
- Potential for Harm and Privacy Are Top AI Ethics Concerns: Evidence From a Representative UK Survey
- Ethics and Governance of Artificial Intelligence: Evidence from a Survey of Machine Learning Researchers
- <i>When Algorithms Err</i> : Differential Impact of Early vs. Late Errors on Users’ Reliance on Algorithms
- Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAI
- In Generative AI We (Dis)Trust? Computational Analysis of Trust and Distrust in Reddit Discussions
- Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Survey
- Human Trust in Artificial Intelligence: Review of Empirical Research
- Enhancing autonomy transparency: an option-centric rationale approach
- From Mass Media and Social Media to AI: A Multilevel Framework for Understanding Trust in Generative AI
- Designing Intent Communication for Agent-Human Collaboration
- R-AI-diographers: a European survey on perceived impact of AI on professional identity, careers, and radiographers’ roles
- The Formation of Trust in Autonomous Vehicles after Interacting with Robotaxis on Public Roads
- Embedding artificial intelligence in society: looking beyond the EU AI master plan using the culture cycle
- Trust in artificial intelligence: a survey experiment to assess trust in algorithmic decision-making
- Trust in Collaborative Automation in High Stakes Software Engineering Work: A Case Study at NASA
- “It Became My Buddy, But I’m Not Afraid to Disagree”: A Multi-Session Study of UX Evaluators Collaborating with Conversational AI Assistants
- A Review on Trust in Human-Robot Interaction
- AI Error Difficulty Modulates the Effectiveness of Explainability in Decision Support Systems
- Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration
- Measuring Large Language Models Dependency: Validating the Arabic Version of the LLM-D12 Scale
- Twenty-four years of empirical research on trust in AI: a bibliometric review of trends, overlooked issues, and future directions
- Trustworthy Transparency by Design
- In AI We Trust? Factors That Influence Trustworthiness of AI-infused Decision-Making Processes
- Trust and trustworthy artificial intelligence: A research agenda for AI in the environmental sciences
- BreastScreening-AI: Evaluating medical intelligent agents for human-AI interactions
- Exploring a biocentric LLM-based assistant in environmental decision-making with more-than-human representation of the Tagus Estuary
- Towards Transparent Ethical AI: A Roadmap for Trustworthy Robotic Systems
- A Little Anthropomorphism Goes a Long Way. [europepmc]
- Automation Expectation Mismatch: Incorrect Prediction Despite Eyes on Threat and Hands on Wheel. [europepmc]
- Communicating Intent of Automated Vehicles to Pedestrians. [europepmc]
- Learning From the Slips of Others: Neural Correlates of Trust in Automated Agents. [europepmc]
- Trust and distrust in information systems at the workplace. [europepmc]
- On the future of transportation in an era of automated and autonomous vehicles. [europepmc]
- Trusting Robocop: Gender-Based Effects on Trust of an Autonomous Robot. [europepmc]
- Individual Differences in Attributes of Trust in Automation: Measurement and Application to System Design. [europepmc]
- Scared to Trust? - Predicting Trust in Highly Automated Driving by Depressiveness, Negative Self-Evaluations and State Anxiety. [europepmc]
- The Challenges of Partially Automated Driving. [europepmc]
- The effects of personality and locus of control on trust in humans versus artificial intelligence. [europepmc]
- Trust Toward Robots and Artificial Intelligence: An Experimental Approach to Human-Technology Interactions Online. [europepmc]
- Developing Self-Awareness in Robots via Inner Speech. [europepmc]
- More Than a Feeling-Interrelation of Trust Layers in Human-Robot Interaction and the Role of User Dispositions and State Anxiety. [europepmc]
- Human-Autonomy Teaming: Definitions, Debates, and Directions. [europepmc]
- Measurement of Trust in Automation: A Narrative Review and Reference Guide. [europepmc]
- A Clinical Decision Support System for Sleep Staging Tasks With Explanations From Artificial Intelligence: User-Centered Design and Evaluation Study. [europepmc]
- Human Factors Considerations and Metrics in Shared Space Human-Robot Collaboration: A Systematic Review. [europepmc]
- Determinants of Laypersons' Trust in Medical Decision Aids: Randomized Controlled Trial. [europepmc]
- Supporting Cognition With Modern Technology: Distributed Cognition Today and in an AI-Enhanced Future. [europepmc]
- Promoting Healthcare Workers' Adoption Intention of Artificial-Intelligence-Assisted Diagnosis and Treatment: The Chain Mediation of Social Influence and Human-Computer Trust. [europepmc]
- An integrative review on the acceptance of artificial intelligence among healthcare professionals in hospitals. [europepmc]
- Trust criteria for artificial intelligence in health: normative and epistemic considerations. [europepmc]
- Grand Challenges in Neurotechnology and System Neuroergonomics. [europepmc]
- Developing trustworthy artificial intelligence: insights from research on interpersonal, human-automation, and human-AI trust. [europepmc]
Related