Realizing a deep reinforcement learning agent for real-time quantum feedback.


Journal

Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555

Informations de publication

Date de publication:
06 Nov 2023
Historique:
received: 17 03 2023
accepted: 25 10 2023
medline: 7 11 2023
pubmed: 7 11 2023
entrez: 6 11 2023
Statut: epublish

Résumé

Realizing the full potential of quantum technologies requires precise real-time control on time scales much shorter than the coherence time. Model-free reinforcement learning promises to discover efficient feedback strategies from scratch without relying on a description of the quantum system. However, developing and training a reinforcement learning agent able to operate in real-time using feedback has been an open challenge. Here, we have implemented such an agent for a single qubit as a sub-microsecond-latency neural network on a field-programmable gate array (FPGA). We demonstrate its use to efficiently initialize a superconducting qubit and train the agent based solely on measurements. Our work is a first step towards adoption of reinforcement learning for the control of quantum devices and more generally any physical device requiring low-latency feedback.

Identifiants

pubmed: 37932251
doi: 10.1038/s41467-023-42901-3
pii: 10.1038/s41467-023-42901-3
pmc: PMC10628214
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

7138

Subventions

Organisme : Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (Swiss National Science Foundation)
ID : 200021_184686

Informations de copyright

© 2023. The Author(s).

Références

Opt Express. 2019 Aug 19;27(17):24223-24230
pubmed: 31510315
Phys Rev Lett. 2021 Nov 5;127(19):190403
pubmed: 34797162
IEEE Trans Neural Netw Learn Syst. 2014 May;25(5):920-33
pubmed: 24808038
Phys Rev Lett. 2005 Aug 5;95(6):060501
pubmed: 16090931
Nature. 2016 Jan 28;529(7587):484-9
pubmed: 26819042
Phys Rev Lett. 2012 Dec 14;109(24):240502
pubmed: 23368293
Nature. 2018 Nov;563(7732):527-531
pubmed: 30397345
Nature. 2013 Aug 15;500(7462):319-22
pubmed: 23955231
Nature. 2016 Aug 25;536(7617):441-5
pubmed: 27437573
Nature. 2023 Apr;616(7955):50-55
pubmed: 36949196
Phys Rev Lett. 2015 May 22;114(20):200501
pubmed: 26047215
Sci Robot. 2021 Mar 24;6(52):
pubmed: 34043550
Nature. 2018 Sep;561(7723):368-373
pubmed: 30185908
Phys Rev Lett. 2018 Aug 10;121(6):060502
pubmed: 30141638
Nature. 2020 Dec;588(7836):77-82
pubmed: 33268863
Phys Rev Lett. 2021 Feb 12;126(6):060401
pubmed: 33635691
Phys Rev Lett. 2020 Oct 23;125(17):170501
pubmed: 33156669
Nature. 2016 Oct 27;538(7626):491-494
pubmed: 27706145
Nature. 2022 Feb;602(7897):414-419
pubmed: 35173339
Sci Rep. 2022 May 3;12(1):7185
pubmed: 35504948

Auteurs

Kevin Reuer (K)

Department of Physics, ETH Zurich, CH-8093, Zurich, Switzerland. kevin.reuer@phys.ethz.ch.
Quantum Center, ETH Zurich, CH-8093, Zurich, Switzerland. kevin.reuer@phys.ethz.ch.

Jonas Landgraf (J)

Max Planck Institute for the Science of Light, Staudtstraße 2, 91058, Erlangen, Germany.
Physics Department, University of Erlangen-Nuremberg, Staudtstraße 5, 91058, Erlangen, Germany.

Thomas Fösel (T)

Max Planck Institute for the Science of Light, Staudtstraße 2, 91058, Erlangen, Germany.
Physics Department, University of Erlangen-Nuremberg, Staudtstraße 5, 91058, Erlangen, Germany.

James O'Sullivan (J)

Department of Physics, ETH Zurich, CH-8093, Zurich, Switzerland.
Quantum Center, ETH Zurich, CH-8093, Zurich, Switzerland.

Liberto Beltrán (L)

Department of Physics, ETH Zurich, CH-8093, Zurich, Switzerland.
Quantum Center, ETH Zurich, CH-8093, Zurich, Switzerland.

Abdulkadir Akin (A)

Department of Physics, ETH Zurich, CH-8093, Zurich, Switzerland.
Quantum Center, ETH Zurich, CH-8093, Zurich, Switzerland.

Graham J Norris (GJ)

Department of Physics, ETH Zurich, CH-8093, Zurich, Switzerland.
Quantum Center, ETH Zurich, CH-8093, Zurich, Switzerland.

Ants Remm (A)

Department of Physics, ETH Zurich, CH-8093, Zurich, Switzerland.
Quantum Center, ETH Zurich, CH-8093, Zurich, Switzerland.

Michael Kerschbaum (M)

Department of Physics, ETH Zurich, CH-8093, Zurich, Switzerland.
Quantum Center, ETH Zurich, CH-8093, Zurich, Switzerland.

Jean-Claude Besse (JC)

Department of Physics, ETH Zurich, CH-8093, Zurich, Switzerland.
Quantum Center, ETH Zurich, CH-8093, Zurich, Switzerland.

Florian Marquardt (F)

Max Planck Institute for the Science of Light, Staudtstraße 2, 91058, Erlangen, Germany.
Physics Department, University of Erlangen-Nuremberg, Staudtstraße 5, 91058, Erlangen, Germany.

Andreas Wallraff (A)

Department of Physics, ETH Zurich, CH-8093, Zurich, Switzerland.
Quantum Center, ETH Zurich, CH-8093, Zurich, Switzerland.

Christopher Eichler (C)

Department of Physics, ETH Zurich, CH-8093, Zurich, Switzerland. christopher.eichler@fau.de.
Physics Department, University of Erlangen-Nuremberg, Staudtstraße 5, 91058, Erlangen, Germany. christopher.eichler@fau.de.

Classifications MeSH