Music can be reconstructed from human auditory cortex activity using nonlinear decoding models.
Journal
PLoS biology
ISSN: 1545-7885
Titre abrégé: PLoS Biol
Pays: United States
ID NLM: 101183755
Informations de publication
Date de publication:
08 2023
08 2023
Historique:
received:
19
09
2022
accepted:
30
05
2023
medline:
17
8
2023
pubmed:
15
8
2023
entrez:
15
8
2023
Statut:
epublish
Résumé
Music is core to human experience, yet the precise neural dynamics underlying music perception remain unknown. We analyzed a unique intracranial electroencephalography (iEEG) dataset of 29 patients who listened to a Pink Floyd song and applied a stimulus reconstruction approach previously used in the speech domain. We successfully reconstructed a recognizable song from direct neural recordings and quantified the impact of different factors on decoding accuracy. Combining encoding and decoding analyses, we found a right-hemisphere dominance for music perception with a primary role of the superior temporal gyrus (STG), evidenced a new STG subregion tuned to musical rhythm, and defined an anterior-posterior STG organization exhibiting sustained and onset responses to musical elements. Our findings show the feasibility of applying predictive modeling on short datasets acquired in single patients, paving the way for adding musical elements to brain-computer interface (BCI) applications.
Identifiants
pubmed: 37582062
doi: 10.1371/journal.pbio.3002176
pii: PBIOLOGY-D-22-02055
pmc: PMC10427021
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Research Support, N.I.H., Extramural
Langues
eng
Sous-ensembles de citation
IM
Pagination
e3002176Subventions
Organisme : NINDS NIH HHS
ID : R01 NS021135
Pays : United States
Organisme : NINDS NIH HHS
ID : U24 NS109103
Pays : United States
Organisme : NINDS NIH HHS
ID : U01 NS108916
Pays : United States
Organisme : NINDS NIH HHS
ID : R13 NS118932
Pays : United States
Organisme : NIBIB NIH HHS
ID : R01 EB026439
Pays : United States
Organisme : NIBIB NIH HHS
ID : P41 EB018783
Pays : United States
Informations de copyright
Copyright: © 2023 Bellier et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Déclaration de conflit d'intérêts
The authors have declared that no competing interests exist.
Références
Clin Med (Lond). 2008 Feb;8(1):32-6
pubmed: 18335666
J Neural Eng. 2014 Oct;11(5):056001
pubmed: 25080161
Nature. 2019 Apr;568(7753):493-498
pubmed: 31019317
Neuroimage. 2019 Oct 15;200:490-500
pubmed: 31254649
J Neurosci. 2011 Sep 7;31(36):12855-65
pubmed: 21900564
Cereb Cortex. 2018 Dec 1;28(12):4222-4233
pubmed: 29088345
Science. 1991 Jun 28;252(5014):1854-7
pubmed: 2063199
Curr Biol. 2022 Apr 11;32(7):1470-1484.e12
pubmed: 35196507
Cortex. 2009 Jan;45(1):93-102
pubmed: 19100973
Science. 2020 Feb 28;367(6481):1043-1047
pubmed: 32108113
J Neurophysiol. 2009 Dec;102(6):3329-39
pubmed: 19759321
Front Syst Neurosci. 2017 Sep 26;11:61
pubmed: 29018336
Nat Protoc. 2018 Jul;13(7):1699-1723
pubmed: 29988107
Proc Biol Sci. 1995 Dec 22;262(1365):259-65
pubmed: 8587884
J Neurosci. 2000 Mar 15;20(6):2315-31
pubmed: 10704507
J Cogn Neurosci. 2002 Apr 1;14(3):430-42
pubmed: 11970802
Front Hum Neurosci. 2014 Oct 13;8:798
pubmed: 25352799
Neuroimage. 2019 Jan 15;185:96-101
pubmed: 30336253
Front Psychol. 2017 Jul 14;8:1179
pubmed: 28769835
J Neurosci. 2012 Feb 1;32(5):1560-76
pubmed: 22302799
J Neurosci. 2011 Mar 9;31(10):3843-52
pubmed: 21389239
Front Neuroinform. 2017 Mar 02;11:14
pubmed: 28303098
Nat Commun. 2022 Jan 10;13(1):48
pubmed: 35013268
Cognition. 2006 May;100(1):1-32
pubmed: 16487953
Comput Intell Neurosci. 2011;2011:156869
pubmed: 21253357
Neuroimage. 2009 Oct 1;47(4):1894-903
pubmed: 19376241
Trends Cogn Sci. 2002 Jan 1;6(1):37-46
pubmed: 11849614
J Neurosci Methods. 2004 Aug 30;137(2):321-32
pubmed: 15262077
J Physiol Paris. 2003 Jul-Nov;97(4-6):613-28
pubmed: 15242670
J Neurosci. 2017 Jul 5;37(27):6539-6557
pubmed: 28588065
Nat Protoc. 2020 Apr;15(4):1399-1435
pubmed: 32203486
Brain Behav. 2021 Jan;11(1):e01936
pubmed: 33164348
Brain Res Cogn Brain Res. 2004 Nov;21(3):351-9
pubmed: 15511651
Handb Clin Neurol. 2015;129:187-205
pubmed: 25726270
Cereb Cortex. 2011 Jul;21(7):1507-18
pubmed: 21071617
PLoS Biol. 2012 Jan;10(1):e1001251
pubmed: 22303281
Neuroimage. 1999 Feb;9(2):179-94
pubmed: 9931268
Front Psychol. 2011 Jun 09;2:110
pubmed: 21713060
Sci Rep. 2018 Jan 15;8(1):708
pubmed: 29335643
Annu Rev Psychol. 2005;56:89-114
pubmed: 15709930
Neuroimage. 2014 Aug 15;97:188-95
pubmed: 24768933
Cortex. 2014 Oct;59:126-37
pubmed: 25173956
IEEE Trans Biomed Eng. 2004 Jun;51(6):1034-43
pubmed: 15188875
Neuroimage. 2012 Feb 15;59(4):3677-89
pubmed: 22116038
J Neurosci. 2019 Oct 9;39(41):8112-8123
pubmed: 31501297
Brain Res. 2006 Oct 30;1117(1):162-74
pubmed: 16963000
J Acoust Soc Am. 2005 Aug;118(2):887-906
pubmed: 16158645
Neuroimage. 2012 Jul 16;61(4):841-8
pubmed: 22537600
Curr Biol. 2018 Jun 18;28(12):1860-1871.e4
pubmed: 29861132
Sci Adv. 2020 Aug 12;6(33):eabb0977
pubmed: 32851172
Sci Rep. 2018 Feb 2;8(1):2266
pubmed: 29396524
Neuroimage. 2014 Nov 1;101:598-609
pubmed: 25019680
Philos Trans R Soc Lond B Biol Sci. 2015 Mar 19;370(1664):20140090
pubmed: 25646513
J Neural Eng. 2015 Oct;12(5):056008
pubmed: 26268446
PLoS One. 2013;8(1):e53398
pubmed: 23408924
Proc Natl Acad Sci U S A. 2013 Jun 18;110 Suppl 2:10430-7
pubmed: 23754373
Sci Rep. 2023 Jan 12;13(1):624
pubmed: 36635340
Science. 2002 Dec 13;298(5601):2167-70
pubmed: 12481131
Anat Rec A Discov Mol Cell Evol Biol. 2006 Apr;288(4):435-46
pubmed: 16550543
J Cogn Neurosci. 2011 Oct;23(10):3084-94
pubmed: 21452943
Neuroimage. 2014 Mar;88:170-80
pubmed: 24269803
J Neural Eng. 2014 Apr;11(2):026009
pubmed: 24608228
Neuropsychology. 2021 Nov;35(8):771-791
pubmed: 34435803
Sci Rep. 2019 Jan 29;9(1):874
pubmed: 30696881
J Neurosci. 1999 Sep 15;19(18):8036-42
pubmed: 10479703
J Neurosci Methods. 2014 Mar 30;225:42-56
pubmed: 24447842
Brain. 2013 May;136(Pt 5):1639-61
pubmed: 23616587
eNeuro. 2020 Jul 31;7(4):
pubmed: 32586843
Hum Brain Mapp. 2013 Sep;34(9):2045-54
pubmed: 22431306
PLoS Biol. 2014 Mar 25;12(3):e1001821
pubmed: 24667562
Sci Rep. 2019 Sep 2;9(1):12623
pubmed: 31477742
Front Psychol. 2011 May 12;2:94
pubmed: 21738519
Nat Commun. 2017 Oct 26;8(1):1139
pubmed: 29074960
J Neurosci. 2016 Feb 10;36(6):2014-26
pubmed: 26865624
Nat Rev Neurosci. 2007 May;8(5):393-402
pubmed: 17431404