A Marketplace for Data: An Algorithmic Solution

2018/05/21 by Anish Agarwal, Agarwal, Anish, Munther A. Dahleh +3 · 20 citations
Decision Sciences · Computer Science · #Auction Theory and Applications #Optimization and Search Problems #Advanced Bandit Algorithms Research

paper · pdf · doi:10.48550/arxiv.1805.08125

Abstract

In this work, we aim to design a data marketplace; a robust real-time matching mechanism to efficiently buy and sell training data for Machine Learning tasks. While the monetization of data and pre-trained models is an essential focus of industry today, there does not exist a market mechanism to price training data and match buyers to sellers while still addressing the associated (computational and other) complexity. The challenge in creating such a market stems from the very nature of data as an asset: (i) it is freely replicable; (ii) its value is inherently combinatorial due to correlation with signal in other data; (iii) prediction tasks and the value of accuracy vary widely; (iv) usefulness of training data is difficult to verify a priori without first applying it to a prediction task. As our main contributions we: (i) propose a mathematical model for a two-sided data market and formally define the key associated challenges; (ii) construct algorithms for such a market to function and analyze how they meet the challenges defined. We highlight two technical contributions: (i) a new notion of 'fairness' required for cooperative games with freely replicable goods; (ii) a truthful, zero regret mechanism to auction a class of combinatorial goods based on utilizing Myerson's payment function and the Multiplicative Weights algorithm. These might be of independent interest.

Cited by

• Market Design for AI: Beyond the Copyright Binary
• Shapley-based Data Valuation for LLM Alignment via Sequential Preference Optimization
• Metrics, KPIs, and Taxonomy for Data Valuation and Monetisation -- Internal Processes Perspective
• D2M: A Decentralized, Privacy-Preserving, Incentive-Compatible Data Marketplace for Collaborative Learning
• Sell Data to AI Algorithms Without Revealing It: Secure Data Valuation and Sharing via Homomorphic Encryption
• How to Purchase Labels? A Cost-Effective Approach Using Active Learning Markets
• Rethinking Data Value: Asymmetric Data Shapley for Structure-Aware Valuation in Data Markets and Machine Learning Pipelines
• Reliable and Private Utility Signaling for Data Markets
• GenAI vs. Human Creators: Procurement Mechanism Design in Two-/Three-Layer Markets
• TripleWin: Fixed-Point Equilibrium Pricing for Data-Model Coupled Markets
• Geometric Data Valuation via Leverage Scores
• Eigen-Value: Efficient Domain-Robust Data Valuation via Eigenvalue-Based Approach
• Incentivizing Time-Aware Fairness in Data Sharing
• Data Quality Taxonomy for Data Monetization
• Efficiently Attacking Memorization Scores
• Metrics, KPIs, and Taxonomy for Data Valuation and Monetisation -- A Systematic Literature Review
• Data Valuation and Selection in a Federated Model Marketplace
• Data Auctions for Retrieval Augmented Generation
• Trust and Reputation in Data Sharing: A Survey
• Who's responsible? Jointly quantifying the contribution of the learning algorithm and training data

Related

• Try Before You Buy: A practical data purchasing algorithm for real-world data marketplaces
• Collaborative Machine Learning Markets with Data-Replication-Robust Payments
• Private Data Valuation and Fair Payment in Data Marketplaces
• The Cost of Balanced Training-Data Production in an Online Data Market
• Learn then Decide: A Learning Approach for Designing Data Marketplaces