Intelligent Agent Transparency in Human–Agent Teaming for Multi-UxV Management
2016/02/11 by Joseph Mercado, Joseph E. Mercado, Michael A. Rupp +4 · 34 citations
Psychology · #Human-Automation Interaction and Safety #Social Robot Interaction and HRI #Team Dynamics and Performance
paper · pdf · doi:10.1177/0018720815621206
Abstract
OBJECTIVE: We investigated the effects of level of agent transparency on operator performance, trust, and workload in a context of human-agent teaming for multirobot management. BACKGROUND: Participants played the role of a heterogeneous unmanned vehicle (UxV) operator and were instructed to complete various missions by giving orders to UxVs through a computer interface. An intelligent agent (IA) assisted the participant by recommending two plans-a top recommendation and a secondary recommendation-for every mission. METHOD: A within-subjects design with three levels of agent transparency was employed in the present experiment. There were eight missions in each of three experimental blocks, grouped by level of transparency. During each experimental block, the IA was incorrect three out of eight times due to external information (e.g., commander's intent and intelligence). Operator performance, trust, workload, and usability data were collected. RESULTS: Results indicate that operator performance, trust, and perceived usability increased as a function of transparency level. Subjective and objective workload data indicate that participants' workload did not increase as a function of transparency. Furthermore, response time did not increase as a function of transparency. CONCLUSION: Unlike previous research, which showed that increased transparency resulted in increased performance and trust calibration at the cost of greater workload and longer response time, our results support the benefits of transparency for performance effectiveness without additional costs. APPLICATION: The current results will facilitate the implementation of IAs in military settings and will provide useful data to the design of heterogeneous UxV teams.
Citations
Cited by
- Human–Autonomy Teaming: A Review and Analysis of the Empirical Literature
- Explanation in artificial intelligence: Insights from the social sciences
- ‘Just like I thought’: Street‐level bureaucrats trust <scp>AI</scp> recommendations if they confirm their professional judgment
- Look Who's Talking Now: Implications of AV's Explanations on Driver's Trust, AV Preference, Anxiety and Mental Workload
- Enhancing autonomy transparency: an option-centric rationale approach
- Transparency in Multi-Human Multi-Robot Interaction
- Explanation of Reinforcement Learning Model in Dynamic Multi-Agent System
- The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Results
- Twenty-four years of empirical research on trust in AI: a bibliometric review of trends, overlooked issues, and future directions
- Learning From the Slips of Others: Neural Correlates of Trust in Automated Agents. [europepmc]
- Adaptive trust calibration for human-AI collaboration. [europepmc]
- Human-Autonomy Teaming: A Review and Analysis of the Empirical Literature. [europepmc]
- Inferring Trust From Users' Behaviours; Agents' Predictability Positively Affects Trust, Task Performance and Cognitive Load in Human-Agent Real-Time Collaboration. [europepmc]
- Robot Transparency and Anthropomorphic Attribute Effects on Human-Robot Interactions. [europepmc]
- Agent Transparency, Situation Awareness, Mental Workload, and Operator Performance: A Systematic Literature Review. [europepmc]
- Exploring the influence of a user-specific explainable virtual advisor on health behaviour change intentions. [europepmc]
- A Methodology for Evaluating Operator Usage of Machine Learning Recommendations for Power Grid Contingency Analysis. [europepmc]
- The influence of interdependence and a transparent or explainable communication style on human-robot teamwork. [europepmc]
- Explanatory machine learning for justified trust in human-AI collaboration: Experiments on file deletion recommendations. [europepmc]
- A Bayesian Network Approach to Explainable Reinforcement Learning with Distal Information. [europepmc]
- Reliable and transparent in-vehicle agents lead to higher behavioral trust in conditionally automated driving systems. [europepmc]
- Transparent Automated Advice to Mitigate the Impact of Variation in Automation Reliability. [europepmc]
- How Terminology Affects Users' Responses to System Failures. [europepmc]
- Psychological assessment of AI-based decision support systems: tool development and expected benefits. [europepmc]
- Supporting detection of hostile intentions: automated assistance in a dynamic decision-making context. [europepmc]
- Responsible (use of) AI. [europepmc]
- Transparency improves the accuracy of automation use, but automation confidence information does not. [europepmc]
- Deciphering Automation Transparency: Do the Benefits of Transparency Differ Based on Whether Decision Recommendations Are Provided? [europepmc]
- The Effects of Presenting AI Uncertainty Information on Pharmacists' Trust in Automated Pill Recognition Technology: Exploratory Mixed Subjects Study. [europepmc]
- Transparent systems, opaque results: a study on automation compliance and task performance. [europepmc]
- Self-assessment in machines boosts human Trust. [europepmc]
- Dissociable effects of fatigue on performance and metacognition from automatic target cuing in undersea threat detection. [europepmc]
- Adaptable Automation Transparency: Should Humans Be Provided Flexibility to Self-Select Transparency Information? [europepmc]
- A Systematic Review and Taxonomy of Human-Agent Teaming Testbeds. [europepmc]
Related