On the missing data layer and a potential solution

2026/08/03 by Francis F Daniel, Mauro Ibañez, Francis Perelman +1
Computer Science · #cs.AI #cs.DB

paper · pdf

7 pages

arxiv created 2026/08/03 · arxiv updated 2026/08/05

Abstract

Latin America is missing two foundational layers of AI infrastructure: the dataset layer and the benchmark layer. This paper targets the dataset layer. The dataset layer faces two compounding problems: discovery and supply. Latin American AI datasets exist but are scattered across platforms with no shared index. Even with perfect indexing, the total volume would remain far below what frontier AI development requires. We propose DataHub: a task-first data infrastructure organized through the ontology /<task?>/<domain?>/<language?>, with mechanisms for dataset discovery, metadata, contribution, licensing, and reuse.

Citations

• Croissant: A Metadata Format for ML-Ready Datasets
• Large Language Models are Geographically Biased
• Cultural bias and cultural alignment of large language models
• Modeling community standards for metadata as templates makes data FAIR
• On the Dangers of Stochastic Parrots
• HuggingFace's Transformers: State-of-the-art Natural Language Processing
• Datasheets for Datasets
• Beyond Markets and States: Polycentric Governance of Complex Economic Systems
• Some Simple Economics of Open Source