GPT on a Quantum Computer

2024/03/14 by Yidong Liao, Liao, Yidong, Christopher Ferrie +1 · 2 citations
Computer Science · Physics and Astronomy · #FOS: Physical sciences #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum Mechanics and Applications #Quantum Physics (quant-ph)

paper · pdf · doi:10.48550/arxiv.2403.09418

openalex publication_date 2024/03/14 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Large Language Models (LLMs) such as ChatGPT have transformed how we interact with and understand the capabilities of Artificial Intelligence (AI). However, the intersection of LLMs with the burgeoning field of Quantum Machine Learning (QML) is only in its nascent stages. This paper presents an exploration of this niche by detailing a comprehensive framework for implementing the foundational Transformer architecture -- integral to ChatGPT -- within a quantum computing paradigm. We meticulously design quantum circuits that implement adapted versions of the transformer's core components and the generative pre-training phase. By integrating quantum computing with LLMs, we aspire to open new avenues for research in QML and contribute to the ongoing evolution of AI technologies.

Cited by

• Practical Hybrid Quantum Language Models with Observable Readout on Real Hardware
• Accelerating the drive towards energy-efficient generative AI with quantum computing algorithms

Related

• Unleashing the Potential of LLMs for Quantum Computing: A Study in Quantum Architecture Design
• Quantum Machine Learning: An Interplay Between Quantum Computing and Machine Learning
• Programming Quantum Computers with Large Language Models
• Quantum Machine Learning: A Hands-on Tutorial for Machine Learning Practitioners and Researchers
• The Dawn of Quantum Natural Language Processing