Human–Autonomy Teaming: A Review and Analysis of the Empirical Literature

2020/10/22 by Thomas O’Neill, Tom O’Neill, Nathan J. McNeese +5 · 551 citations
Engineering · Psychology · Social Sciences · #Agency (philosophy) #Autonomy #Business #Computer science #Empirical research #Engineering #Government (linguistics) #Human-Automation Interaction and Safety #Inclusion (mineral) #Innovation, Sustainability, Human-Machine Systems #Knowledge management #Management #Management science #Political science #Process management #Psychology #Set (abstract data type) #Social psychology #Sociology #Task (project management) #Team Dynamics and Performance #Team composition #Teamwork

paper · doi:10.1177/0018720820960865

published in Human Factors The Journal of the Human Factors and Ergonomics Society 64(5), 904-938 (SAGE Publishing)

openalex publication_date 2020/10/22 · openalex created_date 2020/10/29 · openalex updated_date 2026/08/04

Abstract

OBJECTIVE: We define human-autonomy teaming and offer a synthesis of the existing empirical research on the topic. Specifically, we identify the research environments, dependent variables, themes representing the key findings, and critical future research directions. BACKGROUND: Whereas a burgeoning literature on high-performance teamwork identifies the factors critical to success, much less is known about how human-autonomy teams (HATs) achieve success. Human-autonomy teamwork involves humans working interdependently toward a common goal along with autonomous agents. Autonomous agents involve a degree of self-government and self-directed behavior (agency), and autonomous agents take on a unique role or set of tasks and work interdependently with human team members to achieve a shared objective. METHOD: We searched the literature on human-autonomy teaming. To meet our criteria for inclusion, the paper needed to involve empirical research and meet our definition of human-autonomy teaming. We found 76 articles that met our criteria for inclusion. RESULTS: We report on research environments and we find that the key independent variables involve autonomous agent characteristics, team composition, task characteristics, human individual differences, training, and communication. We identify themes for each of these and discuss the future research needs. CONCLUSION: There are areas where research findings are clear and consistent, but there are many opportunities for future research. Particularly important will be research that identifies mechanisms linking team input to team output variables.

Citations

• Does Team Training Improve Team Performance? A Meta-Analysis
• Humans and Automation: Use, Misuse, Disuse, Abuse
• Intelligent Agent Transparency in Human–Agent Teaming for Multi-UxV Management

Cited by

• Agentic AI Autonomy Assessment: A Decision-Support Framework Towards Governed Supply Chain Systems
• Human Agency and Creativity in AI-Assisted Learning Environments
• An Approach to Joint Hybrid Decision Making between Humans and Artificial Intelligence
• Examining the impact of varying levels of AI teammate influence on human-AI teams
• Unveiling Team Emergent States in the Age of Human-AI Teaming
• Stability and Robustness of Time-Varying Opinion Dynamics: A Graph-Theoretic Approach
• Exploring Human-AI Collaboration Using Mental Models of Early Adopters of Multi-Agent Generative AI Tools
• An Exploratory Study on AI-driven Visualisation Techniques on Decision Making in Extended Reality
• Human-Centered Human-AI Collaboration (HCHAC)
• Collective Cognition in Hybrid Groups: A Network Science Synthesis
• Principles for ‘intelligent assistant’ systems in future flight deck design: autonomous action integration to reduce pilot workload
• Birds of a Different Feather Flock Together: Exploring Opportunities and Challenges in Animal-Human-Machine Teaming
• Toward Resilient Human-AI Collaboration: A Lifecycle Taxonomy of Sociotechnical Risks and Cascading Failures
• Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspective
• Measurement of Trust in Automation: A Narrative Review and Reference Guide. [europepmc]
• Agent Transparency, Situation Awareness, Mental Workload, and Operator Performance: A Systematic Literature Review. [europepmc]
• Bayesian modeling of human-AI complementarity. [europepmc]
• Comparing artificial intelligence and human coaching goal attainment efficacy. [europepmc]
• Assessing Team Effectiveness by How Players Structure Their Search in a First-Person Multiplayer Video Game. [europepmc]
• Conversation dynamics in a multiplayer video game with knowledge asymmetry. [europepmc]
• From Teams to Teamness: Future Directions in the Science of Team Cognition. [europepmc]
• Fostering Collective Intelligence in Human-AI Collaboration: Laying the Groundwork for COHUMAIN. [europepmc]
• Reducing the Costs of Automation Failure by Providing Voluntary Automation Checking Tools. [europepmc]
• Human-AI teaming: leveraging transactive memory and speaking up for enhanced team effectiveness. [europepmc]
• Human-AI teams-Challenges for a team-centered AI at work. [europepmc]
• Defining human-AI teaming the human-centered way: a scoping review and network analysis. [europepmc]
• Supporting detection of hostile intentions: automated assistance in a dynamic decision-making context. [europepmc]
• Humans and cyber-physical systems as teammates? Characteristics and applicability of the human-machine-teaming concept in intelligent manufacturing. [europepmc]
• Training in new forms of human-AI interaction improves complex working memory and switching skills of language professionals. [europepmc]
• Low-rank human-like agents are trusted more and blamed less in human-autonomy teaming. [europepmc]
• Intermediate Judgments and Trust in Artificial Intelligence-Supported Decision-Making. [europepmc]
• Quantum-inspired modeling of distributed intelligence systems with artificial intelligent agents self-organization. [europepmc]
• Human control of AI systems: from supervision to teaming. [europepmc]
• Dissociable effects of fatigue on performance and metacognition from automatic target cuing in undersea threat detection. [europepmc]
• A Systematic Review of Empirical Studies on Situation Awareness: Perspectives From the Interaction Among Humans, Machines, and the Task Environment. [europepmc]
• A Systematic Review and Taxonomy of Human-Agent Teaming Testbeds. [europepmc]
• Space exploration and lifestyle medicine: a narrative review of its implications for astronaut health and remote Earth-based environments. [europepmc]
• When robots reshape teams: neurodynamic insights into taskwork and teamwork in search and rescue. [europepmc]
• Applications of human-machine collaborative decision-making: A review of research with recent developments. [europepmc]

Related

• Tools and methods for Human-Autonomy Teaming: Contributions to cognitive state monitoring and system adaptation
• A Critique of Human-Autonomous Team Dynamics: Contrasting Qualitative and Quantitative Perspectives
• Unraveling Human-AI Teaming: A Review and Outlook
• Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspective
• Gaze-informed Signatures of Trust and Collaboration in Human-Autonomy Teams