2025/04/07 by Stefan Buijsman, Buijsman, Stefan, Herman Veluwenkamp +1
Environmental Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #Emerging Technologies (cs.ET) #Environmental and Social Impact Assessments #Ethics and Social Impacts of AI #FOS: Computer and information sciences #Sustainability and Climate Change Governance
paper · pdf · doi:10.48550/arxiv.2504.05007
openalex publication_date 2025/04/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
AI Impact Assessments are only as good as the measures used to assess the impact of these systems. It is therefore paramount that we can justify our choice of metrics in these assessments, especially for difficult to quantify ethical and social values. We present a two-step approach to ensure metrics are properly motivated. First, a conception needs to be spelled out (e.g. Rawlsian fairness or fairness as solidarity) and then a metric can be fitted to that conception. Both steps require separate justifications, as conceptions can be judged on how well they fit with the function of, for example, fairness. We argue that conceptual engineering offers helpful tools for this step. Second, metrics need to be fitted to a conception. We illustrate this process through an examination of competing fairness metrics to illustrate that here the additional content that a conception offers helps us justify the choice for a specific metric. We thus advocate that impact assessments are not only clear on their metrics, but also on the conceptions that motivate those metrics.