Hierarchical Knowledge Graph Construction from Images for Scalable E-Commerce

2024/10/28 by Yang, Zhantao, Zhang, Han, Chen, Fangyi +2
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences

paper · doi:10.48550/arxiv.2410.21237

Abstract

Knowledge Graph (KG) is playing an increasingly important role in various AI systems. For e-commerce, an efficient and low-cost automated knowledge graph construction method is the foundation of enabling various successful downstream applications. In this paper, we propose a novel method for constructing structured product knowledge graphs from raw product images. The method cooperatively leverages recent advances in the vision-language model (VLM) and large language model (LLM), fully automating the process and allowing timely graph updates. We also present a human-annotated e-commerce product dataset for benchmarking product property extraction in knowledge graph construction. Our method outperforms our baseline in all metrics and evaluated properties, demonstrating its effectiveness and bright usage potential.

Related

• AI Agent-Driven Framework for Automated Product Knowledge Graph Construction in E-Commerce
• Billion-scale Pre-trained E-commerce Product Knowledge Graph Model
• PKGM: A Pre-trained Knowledge Graph Model for E-commerce Application
• A Survey on State-of-the-art Techniques for Knowledge Graphs Construction and Challenges ahead
• Knowledge Graph Completion Models are Few-shot Learners: An Empirical Study of Relation Labeling in E-commerce with LLMs