RecGPT: Generative Pre-training for Text-based Recommendation

2024/05/21 by Ngo, Hoang, Nguyen, Dat Quoc · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)

paper · doi:10.48550/arxiv.2405.12715

Abstract

We present the first domain-adapted and fully-trained large language model, RecGPT-7B, and its instruction-following variant, RecGPT-7B-Instruct, for text-based recommendation. Experimental results on rating prediction and sequential recommendation tasks show that our model, RecGPT-7B-Instruct, outperforms previous strong baselines. We are releasing our RecGPT models as well as their pre-training and fine-tuning datasets to facilitate future research and downstream applications in text-based recommendation. Public "huggingface" links to our RecGPT models and datasets are available at: https://github.com/VinAIResearch/RecGPT

Cited by

• A Survey on Generative Recommendation: Data, Model, and Tasks
• PET: Preference Evolution Tracking with LLM-Generated Explainable Distribution
• Evaluating Recabilities of Foundation Models: A Multi-Domain, Multi-Dataset Benchmark

Related

• RecBase: Generative Foundation Model Pretraining for Zero-Shot Recommendation
• RecGPT: Generative Personalized Prompts for Sequential Recommendation via ChatGPT Training Paradigm
• Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learning
• Pre-train, Prompt and Recommendation: A Comprehensive Survey of Language Modelling Paradigm Adaptations in Recommender Systems
• IDGenRec: LLM-RecSys Alignment with Textual ID Learning