vix.ing · top · new · best · stats · spec

Interactive AI Alignment: Specification, Process, and Evaluation Alignment

2023/10/23 by Michael Terry, Terry, Michael, Chinmay Kulkarni +7 · 7 citations
Social Sciences · Business, Management and Accounting · Engineering · #Ethics and Social Impacts of AI #Big Data and Business Intelligence #Technology Assessment and Management

paper · pdf · doi:10.48550/arxiv.2311.00710

Abstract

Modern AI enables a high-level, declarative form of interaction: Users describe the intended outcome they wish an AI to produce, but do not actually create the outcome themselves. In contrast, in traditional user interfaces, users invoke specific operations to create the desired outcome. This paper revisits the basic input-output interaction cycle in light of this declarative style of interaction, and connects concepts in AI alignment to define three objectives for interactive alignment of AI: specification alignment (aligning on what to do), process alignment (aligning on how to do it), and evaluation alignment (assisting users in verifying and understanding what was produced). Using existing systems as examples, we show how these user-centered views of AI alignment can be used descriptively, prescriptively, and as an evaluative aid.

Cited by

Related