vix.ing · top · new · best · stats · spec

HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face

2023/03/30 by Yongliang Shen, Shen, Yongliang, Kaitao Song +10 · 2 voices · 313 citations
Computer Science · Engineering · #Artificial intelligence #Computer science #Face (sociological concept) #Ferroelectric and Negative Capacitance Devices #Human–computer interaction #Interface (matter) #Linguistics #Modalities #Multimodal Machine Learning Applications #Natural language processing #Task (project management) #Topic Modeling

paper · pdf · doi:10.48550/arxiv.2303.17580

openalex publication_date 2023/03/30 · openalex created_date 2023/04/05 · openalex updated_date 2026/07/28

Abstract

Solving complicated AI tasks with different domains and modalities is a key step toward artificial general intelligence. While there are numerous AI models available for various domains and modalities, they cannot handle complicated AI tasks autonomously. Considering large language models (LLMs) have exhibited exceptional abilities in language understanding, generation, interaction, and reasoning, we advocate that LLMs could act as a controller to manage existing AI models to solve complicated AI tasks, with language serving as a generic interface to empower this. Based on this philosophy, we present HuggingGPT, an LLM-powered agent that leverages LLMs (e.g., ChatGPT) to connect various AI models in machine learning communities (e.g., Hugging Face) to solve AI tasks. Specifically, we use ChatGPT to conduct task planning when receiving a user request, select models according to their function descriptions available in Hugging Face, execute each subtask with the selected AI model, and summarize the response according to the execution results. By leveraging the strong language capability of ChatGPT and abundant AI models in Hugging Face, HuggingGPT can tackle a wide range of sophisticated AI tasks spanning different modalities and domains and achieve impressive results in language, vision, speech, and other challenging tasks, which paves a new way towards the realization of artificial general intelligence.

Cited by

Discussions

Related