Asynchronous training of quantum reinforcement learning

2023/01/12 by Samuel Yen-Chi Chen, Chen, Samuel Yen-Chi · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Neural Networks and Reservoir Computing #Neural and Evolutionary Computing (cs.NE) #Parallel #Quantum Computing Algorithms and Architecture #Quantum Information and Cryptography #Quantum Physics (quant-ph) #and Cluster Computing (cs.DC)

paper · pdf · doi:10.48550/arxiv.2301.05096

openalex publication_date 2023/01/12 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The development of quantum machine learning (QML) has received a lot of interest recently thanks to developments in both quantum computing (QC) and machine learning (ML). One of the ML paradigms that can be utilized to address challenging sequential decision-making issues is reinforcement learning (RL). It has been demonstrated that classical RL can successfully complete many difficult tasks. A leading method of building quantum RL agents relies on the variational quantum circuits (VQC). However, training QRL algorithms with VQCs requires significant amount of computational resources. This issue hurdles the exploration of various QRL applications. In this paper, we approach this challenge through asynchronous training QRL agents. Specifically, we choose the asynchronous training of advantage actor-critic variational quantum policies. We demonstrate the results via numerical simulations that within the tasks considered, the asynchronous training of QRL agents can reach performance comparable to or superior than classical agents with similar model sizes and architectures.

Cited by

• Q-A3C2: Quantum Reinforcement Learning with Time-Series Dynamic Clustering for Adaptive ETF Stock Selection
• Quantum Reinforcement Learning: Recent Advances and Future Directions
• Quantum-Enhanced Forecasting for Deep Reinforcement Learning in Algorithmic Trading
• Quantum Reinforcement Learning by Adaptive Non-local Observables

Related

• Quantum Multi-Agent Reinforcement Learning via Variational Quantum Circuit Design
• Differentiable Quantum Architecture Search in Asynchronous Quantum Reinforcement Learning
• Efficient quantum recurrent reinforcement learning via quantum reservoir computing
• An Introduction to Quantum Reinforcement Learning (QRL)
• Quantum Advantage Actor-Critic for Reinforcement Learning