vix.ing · top · new · best · stats · spec

Ducho 2.0: Towards a More Up-to-Date Unified Framework for the Extraction of Multimodal Features in Recommendation

2024/03/07 by Matteo Attimonelli, Danilo Danese, Attimonelli, Matteo +9 · 3 citations
Computer Science · #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Video Analysis and Summarization

paper · pdf · doi:10.48550/arxiv.2403.04503

openalex publication_date 2024/03/07 · openalex created_date 2024/03/09 · openalex updated_date 2026/07/28

Abstract

In this work, we introduce Ducho 2.0, the latest stable version of our framework. Differently from Ducho, Ducho 2.0 offers a more personalized user experience with the definition and import of custom extraction models fine-tuned on specific tasks and datasets. Moreover, the new version is capable of extracting and processing features through multimodal-by-design large models. Notably, all these new features are supported by optimized data loading and storing to the local memory. To showcase the capabilities of Ducho 2.0, we demonstrate a complete multimodal recommendation pipeline, from the extraction/processing to the final recommendation. The idea is to provide practitioners and experienced scholars with a ready-to-use tool that, put on top of any multimodal recommendation framework, may permit them to run extensive benchmarking analyses. All materials are accessible at: \urlhttps://github.com/sisinflab/Ducho.

Cited by

Related