vix.ing · top · new · best · stats · spec

On the Suitability of Hugging Face Hub for Empirical Studies

2023/07/27 by Adem Ait, Ait, Adem, Javier Luis Izquierdo +3 · 4 citations
Business, Management and Accounting · Computer Science · Decision Sciences · #Big Data and Business Intelligence #FOS: Computer and information sciences #Scientific Computing and Data Management #Software Engineering (cs.SE) #Software Engineering Research

paper · pdf · doi:10.48550/arxiv.2307.14841

openalex publication_date 2023/07/27 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Background. The development of empirical studies in software engineering mainly relies on the data available on code hosting platforms, being GitHub the most representative. Nevertheless, in the last years, the emergence of Machine Learning (ML) has led to the development of platforms specifically designed for developing ML-based projects, being Hugging Face Hub (HFH) the most popular one. With over 250k repositories, and growing fast, HFH is becoming a promising ecosystem of ML artifacts and therefore a potential source of data for empirical studies. However, so far there have been no studies evaluating the potential of HFH for such studies. Objective. In this proposal for a registered report, we aim at performing an exploratory study of the current state of HFH in order to investigate its suitability to be used as a source platform for empirical studies. Method. We conduct a qualitative and quantitative analysis of HFH for empirical studies. The former will be performed by comparing the features of HFH with those of other code hosting platforms, such as GitHub and GitLab. The latter will be performed by analyzing the data available in HFH.

Cited by

Related