Realizing a deep reinforcement learning agent for real-time quantum feedback.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
06 Nov 2023
06 Nov 2023
Historique:
received:
17
03
2023
accepted:
25
10
2023
medline:
7
11
2023
pubmed:
7
11
2023
entrez:
6
11
2023
Statut:
epublish
Résumé
Realizing the full potential of quantum technologies requires precise real-time control on time scales much shorter than the coherence time. Model-free reinforcement learning promises to discover efficient feedback strategies from scratch without relying on a description of the quantum system. However, developing and training a reinforcement learning agent able to operate in real-time using feedback has been an open challenge. Here, we have implemented such an agent for a single qubit as a sub-microsecond-latency neural network on a field-programmable gate array (FPGA). We demonstrate its use to efficiently initialize a superconducting qubit and train the agent based solely on measurements. Our work is a first step towards adoption of reinforcement learning for the control of quantum devices and more generally any physical device requiring low-latency feedback.
Identifiants
pubmed: 37932251
doi: 10.1038/s41467-023-42901-3
pii: 10.1038/s41467-023-42901-3
pmc: PMC10628214
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
7138Subventions
Organisme : Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (Swiss National Science Foundation)
ID : 200021_184686
Informations de copyright
© 2023. The Author(s).
Références
Opt Express. 2019 Aug 19;27(17):24223-24230
pubmed: 31510315
Phys Rev Lett. 2021 Nov 5;127(19):190403
pubmed: 34797162
IEEE Trans Neural Netw Learn Syst. 2014 May;25(5):920-33
pubmed: 24808038
Phys Rev Lett. 2005 Aug 5;95(6):060501
pubmed: 16090931
Nature. 2016 Jan 28;529(7587):484-9
pubmed: 26819042
Phys Rev Lett. 2012 Dec 14;109(24):240502
pubmed: 23368293
Nature. 2018 Nov;563(7732):527-531
pubmed: 30397345
Nature. 2013 Aug 15;500(7462):319-22
pubmed: 23955231
Nature. 2016 Aug 25;536(7617):441-5
pubmed: 27437573
Nature. 2023 Apr;616(7955):50-55
pubmed: 36949196
Phys Rev Lett. 2015 May 22;114(20):200501
pubmed: 26047215
Sci Robot. 2021 Mar 24;6(52):
pubmed: 34043550
Nature. 2018 Sep;561(7723):368-373
pubmed: 30185908
Phys Rev Lett. 2018 Aug 10;121(6):060502
pubmed: 30141638
Nature. 2020 Dec;588(7836):77-82
pubmed: 33268863
Phys Rev Lett. 2021 Feb 12;126(6):060401
pubmed: 33635691
Phys Rev Lett. 2020 Oct 23;125(17):170501
pubmed: 33156669
Nature. 2016 Oct 27;538(7626):491-494
pubmed: 27706145
Nature. 2022 Feb;602(7897):414-419
pubmed: 35173339
Sci Rep. 2022 May 3;12(1):7185
pubmed: 35504948