Relationship Between Trust in the AI Creator and Trust in AI Systems: The Crucial Role of AI Alignment and Steerability

2024/07/02 by Kambiz Saffarizadeh, Mark Keil, Likoebe M. Maruping +1 · 1 citation
Decision Sciences · Social Sciences · #Ethics and Social Impacts of AI #Impact of AI and Big Data on Business and Society #Technology Adoption and User Behaviour

paper · doi:10.1080/07421222.2024.2376382

openalex publication_date 2024/07/02 · openalex created_date 2024/09/05 · openalex updated_date 2026/07/31

Abstract

This paper offers a novel perspective on trust in artificial intelligence (AI) systems, focusing on the transfer of user trust in AI creators to trust in AI systems. Using the agentic information systems (IS) framework, we investigate the role of AI alignment and steerability in trust transference. Through four randomized experiments, we probe three key alignment-related attributes of AI systems: creator-based steerability, user-based steerability, and autonomy. Results indicate that creator-based steerability amplifies trust transference from AI creator to AI system, while user-based steerability and autonomy diminish it. Our findings suggest that AI alignment efforts should consider the entity with which the AI goals and values should be aligned and highlight the need for research to theorize from a triadic view encompassing the user, the AI system, and its creator. Given the diversity in individual goals and values, we recommend that developers move beyond the prevailing “one-size-fits-all” alignment strategy. Our findings contribute to trust transference theory by highlighting the boundary conditions under which trust transference breaks down or holds in the emerging human-AI environment.

Citations

• Trust and TAM in Online Shopping: An Integrated Model1
• Agency and Trust Mechanisms in Consumer Satisfaction and Loyalty Judgments
• On the Morality of Artificial Agents
• The Chain of Effects from Brand Trust and Brand Affect to Brand Performance: The Role of Brand Loyalty
• Algorithm appreciation: People prefer algorithmic to human judgment
• People are averse to machines making moral decisions
• Making sense of recommendations
• Resistance to Medical Artificial Intelligence
• Task-Dependent Algorithm Aversion
• A systematic review of algorithm aversion in augmented decision making
• Artificial Intelligence, Values, and Alignment
• Human Trust in Artificial Intelligence: Review of Empirical Research
• Generalizing from a Few Examples
• Algorithm aversion: People erroneously avoid algorithms after seeing them err.
• The Next Generation of Research on IS Use: A Theoretical Framework of Delegation to and from Agentic IS Artifacts
• Is AI Ground Truth Really True? The Dangers of Training and Evaluating AI Tools Based on Experts’ Know-What
• Training language models to follow instructions with human feedback
• An Integrative Model of Organizational Trust
• Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
• Fine-tuning language models to find agreement among humans with diverse preferences

Cited by

• Governance-as-a-Service: A Multi-Agent Framework for AI System Compliance and Policy Enforcement