2017/01/17 by Samuel Albanie, Albanie, Samuel, Hillary Shakespeare +3 · 1 citation
Computer Science · Mathematics · #Advanced Malware Detection Techniques #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (stat.ML) #Mobile Crowdsensing and Crowdsourcing #Reinforcement Learning in Robotics #Social and Information Networks (cs.SI) #cs.AI #cs.SI #stat.ML
paper · pdf · doi:10.48550/arxiv.1701.04895
NIPS Symposium 2016: Machine Learning and the Law
arxiv created 2017/01/17 · openalex publication_date 2017/01/17 · arxiv updated 2017/01/25 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
For a social networking service to acquire and retain users, it must find ways to keep them engaged. By accurately gauging their preferences, it is able to serve them with the subset of available content that maximises revenue for the site. Without the constraints of an appropriate regulatory framework, we argue that a sufficiently sophisticated curator algorithm tasked with performing this process may choose to explore curation strategies that are detrimental to users. In particular, we suggest that such an algorithm is capable of learning to manipulate its users, for several qualitative reasons: 1. Access to vast quantities of user data combined with ongoing breakthroughs in the field of machine learning are leading to powerful but uninterpretable strategies for decision making at scale. 2. The availability of an effective feedback mechanism for assessing the short and long term user responses to curation strategies. 3. Techniques from reinforcement learning have allowed machines to learn automated and highly successful strategies at an abstract level, often resulting in non-intuitive yet nonetheless highly appropriate action selection. In this work, we consider the form that these strategies for user manipulation might take and scrutinise the role that regulation should play in the design of such systems.