Deep Learning in Biomedical Optics.
biomedical optics
biophotonics
computer aided detection
deep learning
diffuse tomography
fluorescence lifetime
functional optical brain imaging
in vivo microscopy
machine learning
microscopy
optical coherence tomography
photoacoustic imaging
widefield endoscopy
Journal
Lasers in surgery and medicine
ISSN: 1096-9101
Titre abrégé: Lasers Surg Med
Pays: United States
ID NLM: 8007168
Informations de publication
Date de publication:
08 2021
08 2021
Historique:
revised:
02
04
2021
received:
11
01
2021
accepted:
15
04
2021
pubmed:
21
5
2021
medline:
29
10
2021
entrez:
20
5
2021
Statut:
ppublish
Résumé
This article reviews deep learning applications in biomedical optics with a particular emphasis on image formation. The review is organized by imaging domains within biomedical optics and includes microscopy, fluorescence lifetime imaging, in vivo microscopy, widefield endoscopy, optical coherence tomography, photoacoustic imaging, diffuse tomography, and functional optical brain imaging. For each of these domains, we summarize how deep learning has been applied and highlight methods by which deep learning can enable new capabilities for optics in medicine. Challenges and opportunities to improve translation and adoption of deep learning in biomedical optics are also summarized. Lasers Surg. Med. © 2021 Wiley Periodicals LLC.
Identifiants
pubmed: 34015146
doi: 10.1002/lsm.23414
pmc: PMC8273152
mid: NIHMS1708291
doi:
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Research Support, U.S. Gov't, Non-P.H.S.
Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
748-775Subventions
Organisme : NIH HHS
ID : R21EB025621
Pays : United States
Organisme : NIBIB NIH HHS
ID : R21 EB024700
Pays : United States
Organisme : NIH HHS
ID : R21EB024700
Pays : United States
Organisme : NINDS NIH HHS
ID : R01 NS108464
Pays : United States
Organisme : NIBIB NIH HHS
ID : R21 EB025621
Pays : United States
Organisme : NIH HHS
ID : R01CA237267
Pays : United States
Organisme : Medical Technology Enterprise Consortium
ID : 20-05-IMPROVE-004
Organisme : NIH HHS
ID : R01EB019443
Pays : United States
Organisme : NIH HHS
ID : R01NS108464
Pays : United States
Organisme : NIH HHS
ID : R01CA250636
Pays : United States
Organisme : NCI NIH HHS
ID : R01 CA237267
Pays : United States
Organisme : NCI NIH HHS
ID : R01 CA250636
Pays : United States
Organisme : NIH HHS
ID : R01CA207725
Pays : United States
Organisme : NEI NIH HHS
ID : R21 EY029412
Pays : United States
Organisme : Medical Technology Enterprise Consortium
ID : W912CG2120001
Organisme : NIBIB NIH HHS
ID : R01 EB019443
Pays : United States
Organisme : National Science Foundation
ID : 1813848
Organisme : NCI NIH HHS
ID : R01 CA207725
Pays : United States
Organisme : National Science Foundation
ID : 1846784
Commentaires et corrections
Type : CommentIn
Informations de copyright
© 2021 Wiley Periodicals LLC.
Références
Surgery. 2020 Feb;167(2):321-327
pubmed: 31753325
Nat Biomed Eng. 2017;1:
pubmed: 28649464
Gastroenterology. 2009 May;136(5):1509-13
pubmed: 19328799
Opt Lett. 1995 Mar 1;20(5):426-8
pubmed: 19859209
Annu Int Conf IEEE Eng Med Biol Soc. 2015 Aug;2015:2844-7
pubmed: 26736884
APL Photonics. 2020 Apr;5(4):
pubmed: 34368439
J Biomed Opt. 2020 Nov;25(11):
pubmed: 33251783
Opt Lett. 2018 Nov 15;43(22):5669-5672
pubmed: 30439924
Nat Mach Intell. 2019 May;1(5):206-215
pubmed: 35603010
Vis Comput Ind Biomed Art. 2019 Oct 29;2(1):12
pubmed: 32240397
IEEE Trans Med Imaging. 2020 Jun;39(6):2088-2099
pubmed: 31944949
Biomed Opt Express. 2019 Oct 21;10(11):5832-5851
pubmed: 31799050
Can J Psychiatry. 2009 Jan;54(1):6-15
pubmed: 19175975
Nat Biomed Eng. 2021 Jan;5(1):77-88
pubmed: 32719514
Cancer Res. 2015 Apr 1;75(7):1236-43
pubmed: 25670171
Phys Med Biol. 2005 Feb 21;50(4):R1-43
pubmed: 15773619
Stem Cell Reports. 2018 Jun 5;10(6):1687-1695
pubmed: 29754958
Nat Commun. 2020 Dec 7;11(1):6256
pubmed: 33288761
Med Image Anal. 2018 Aug;48:230-243
pubmed: 29990688
Int J Comput Assist Radiol Surg. 2019 Jan;14(1):31-42
pubmed: 30078151
IEEE Trans Med Imaging. 2018 Dec;37(12):2572-2581
pubmed: 29993538
Appl Microbiol Biotechnol. 2012 Nov;96(4):895-902
pubmed: 23053099
Interface Focus. 2011 Aug 6;1(4):602-31
pubmed: 22866233
BME Front. 2020 Dec 5;2020:8620932
pubmed: 37849965
IEEE Access. 2021;9:631-640
pubmed: 33747680
Curr Opin Ophthalmol. 2013 May;24(3):213-21
pubmed: 23429598
Nat Commun. 2018 Jun 15;9(1):2352
pubmed: 29907740
Opt Lett. 2015 Feb 1;40(3):431-4
pubmed: 25680065
Sci Rep. 2020 Jun 15;10(1):9611
pubmed: 32541887
Biomed Opt Express. 2018 Sep 04;9(10):4588-4603
pubmed: 30319888
J Endourol. 2019 Nov;33(11):930-937
pubmed: 31657629
J Biomed Opt. 2007 Nov-Dec;12(6):062104
pubmed: 18163807
Nat Methods. 2018 Dec;15(12):1090-1097
pubmed: 30478326
Med Image Anal. 2021 Jan;67:101841
pubmed: 33142135
Biomed Opt Express. 2019 May 17;10(6):2869-2882
pubmed: 31259057
Opt Lett. 2016 Jun 1;41(11):2561-4
pubmed: 27244414
Sci Rep. 2020 May 22;10(1):8510
pubmed: 32444649
Nature. 2015 May 28;521(7553):436-44
pubmed: 26017442
Opt Lett. 2018 Jun 15;43(12):2752-2755
pubmed: 29905680
Sci Rep. 2020 Mar 3;10(1):3947
pubmed: 32127600
Curr Mol Imaging. 2014;3(2):144-161
pubmed: 26023359
Med Phys. 2004 Apr;31(4):724-33
pubmed: 15124989
Opt Express. 2019 Mar 4;27(5):6158-6183
pubmed: 30876208
IEEE Trans Ultrason Ferroelectr Freq Control. 2020 Dec;67(12):2660-2673
pubmed: 32142429
Biomed Opt Express. 2020 Jan 14;11(2):817-830
pubmed: 32133225
J Biomed Opt. 2018 Sep;24(7):1-20
pubmed: 30218503
Biomed Opt Express. 2020 May 29;11(6):3360-3373
pubmed: 32637260
IEEE Trans Med Imaging. 2020 Nov;39(11):3379-3390
pubmed: 32396076
Med Biol Eng Comput. 2019 Jul;57(7):1451-1463
pubmed: 30900057
Lancet Neurol. 2010 Sep;9(9):921-32
pubmed: 20723847
J Appl Phys. 2020 Aug 14;128(6):060904
pubmed: 32817994
Phys Med Biol. 2018 Sep 13;63(18):185012
pubmed: 30113015
J Biomed Opt. 2017 Dec;22(12):1-17
pubmed: 29260538
Biomed Opt Express. 2010 Aug 2;1(1):165-75
pubmed: 21170299
Cytometry A. 2020 Apr;97(4):407-414
pubmed: 32091180
Biomed Opt Express. 2020 Jun 19;11(7):3857-3874
pubmed: 33014571
IEEE Trans Med Imaging. 2020 Apr;39(4):877-887
pubmed: 31442973
Expert Rev Mol Diagn. 2020 Oct;20(10):1027-1037
pubmed: 32510287
Acad Radiol. 2005 Aug;12(8):934-47
pubmed: 16023382
Theranostics. 2020 Aug 15;10(22):10309-10325
pubmed: 32929350
Opt Lett. 2020 Aug 1;45(15):4232-4235
pubmed: 32735266
J Biomed Opt. 2014 Mar;19(3):36009
pubmed: 24623158
Expert Rev Med Devices. 2014 Mar;11(2):105-7
pubmed: 24387658
J Med Imaging (Bellingham). 2018 Jul;5(3):036001
pubmed: 30840720
Biomed Opt Express. 2019 Feb 07;10(3):1126-1135
pubmed: 30891334
J Biophotonics. 2020 Oct;13(10):e202000212
pubmed: 33405275
Light Sci Appl. 2019 Feb 6;8:23
pubmed: 30728961
Annu Rev Biomed Eng. 2012;14:351-67
pubmed: 22607264
Opt Express. 2019 May 27;27(11):15880-15890
pubmed: 31163777
Sci Rep. 2019 Apr 5;9(1):5694
pubmed: 30952891
BMC Med. 2019 Oct 29;17(1):195
pubmed: 31665002
Biomed Opt Express. 2015 Dec 18;7(1):171-84
pubmed: 26819826
Nat Biomed Eng. 2018 Oct;2(10):741-748
pubmed: 31015647
Lasers Surg Med. 2017 Jan;49(1):7-19
pubmed: 27785781
Opt Express. 2018 Nov 12;26(23):30882-30900
pubmed: 30469980
Annu Int Conf IEEE Eng Med Biol Soc. 2020 Jul;2020:1824-1827
pubmed: 33018354
Nature. 2018 Mar 21;555(7697):487-492
pubmed: 29565357
Nat Protoc. 2011 Aug 11;6(9):1324-40
pubmed: 21886099
Sci Rep. 2017 Sep 20;7(1):11979
pubmed: 28931888
Nat Methods. 2019 Dec;16(12):1323-1331
pubmed: 31686039
Cancers (Basel). 2019 Sep 14;11(9):
pubmed: 31540063
Light Sci Appl. 2020 May 6;9:78
pubmed: 32411363
IEEE Trans Med Imaging. 2020 Jan;39(1):129-139
pubmed: 31180846
Biophys J. 2005 Oct;89(4):2736-49
pubmed: 16040744
Sensors (Basel). 2019 Jan 08;19(1):
pubmed: 30626132
BMC Bioinformatics. 2018 Mar 15;19(1):77
pubmed: 29540156
Am J Ophthalmol. 2019 Feb;198:136-145
pubmed: 30316669
Neuroimage. 2017 Feb 1;146:1038-1049
pubmed: 27693612
Opt Express. 2018 Oct 1;26(20):26470-26484
pubmed: 30469733
Proc Natl Acad Sci U S A. 2020 Aug 4;117(31):18302-18309
pubmed: 32690677
Int J Comput Assist Radiol Surg. 2018 Aug;13(8):1187-1199
pubmed: 29948845
Nat Biotechnol. 2018 Jun;36(5):460-468
pubmed: 29658943
IEEE Trans Med Imaging. 2019 Aug;38(8):1959-1970
pubmed: 30763240
Cytometry A. 2003 Apr;52(2):77-89
pubmed: 12655651
Phys Med Biol. 2005 Jun 21;50(12):2837-58
pubmed: 15930606
Biomed Opt Express. 2019 Feb 19;10(3):1339-1350
pubmed: 30891350
Biomed Opt Express. 2020 Nov 24;11(12):7325-7342
pubmed: 33409000
Microsc Res Tech. 2007 May;70(5):403-9
pubmed: 17393532
IEEE Trans Pattern Anal Mach Intell. 2021 Nov;43(11):4037-4058
pubmed: 32386141
Proc Natl Acad Sci U S A. 2005 Jul 5;102(27):9673-8
pubmed: 15976020
Sci Adv. 2021 Jan 15;7(3):
pubmed: 33523908
J Biophotonics. 2019 Oct;12(10):e201900008
pubmed: 31168927
Med Image Comput Comput Assist Interv. 2020;12261:792-801
pubmed: 34308439
Biomed Opt Express. 2012 Dec 1;3(12):3161-75
pubmed: 23243567
IEEE Trans Med Imaging. 2010 Feb;29(2):465-73
pubmed: 19906585
Cell. 2018 Apr 19;173(3):792-803.e19
pubmed: 29656897
J Biomed Opt. 2009 Nov-Dec;14(6):064010
pubmed: 20059248
Science. 1991 Nov 22;254(5035):1178-81
pubmed: 1957169
Sci Rep. 2020 Apr 14;10(1):6423
pubmed: 32286358
Lab Chip. 2019 Aug 6;19(16):2688-2698
pubmed: 31287108
Biomed Opt Express. 2020 Sep 14;11(10):5557-5564
pubmed: 33149970
Neural Netw. 2020 May;125:92-103
pubmed: 32078964
Arch Pathol Lab Med. 2019 Mar;143(3):288-298
pubmed: 30525931
JAMA Netw Open. 2020 May 1;3(5):e205111
pubmed: 32432709
J Biomed Opt. 2017 Dec;22(12):1-23
pubmed: 29274145
IEEE Trans Med Imaging. 2019 Mar;38(3):791-801
pubmed: 30273147
J Biophotonics. 2020 Apr;13(4):e201960135
pubmed: 31970879
IEEE Trans Med Imaging. 2018 Jun;37(6):1382-1393
pubmed: 29870367
Stem Cell Reports. 2019 Apr 9;12(4):845-859
pubmed: 30880077
Int J Comput Assist Radiol Surg. 2020 Nov;15(11):1807-1816
pubmed: 32808148
Nat Photonics. 2017;11:411-414
pubmed: 29242714
Genes Cells. 2002 Sep;7(9):881-7
pubmed: 12296819
Opt Lett. 2019 Aug 15;44(16):3928-3931
pubmed: 31415514
Rev Cardiovasc Med. 2019 Sep 30;20(3):171-177
pubmed: 31601091
Nat Protoc. 2018 Sep;13(9):1979-2004
pubmed: 30190551
Biomed Opt Express. 2020 Sep 18;11(10):5701-5716
pubmed: 33149980
IEEE Trans Med Imaging. 2018 Jun;37(6):1322-1332
pubmed: 29870362
Light Sci Appl. 2019 Nov 20;8:102
pubmed: 31754429
Brain. 2010 May;133(Pt 5):1352-67
pubmed: 20410145
Int J Comput Assist Radiol Surg. 2020 Jul;15(7):1167-1175
pubmed: 32415459
Nat Photonics. 2014 Jun;8(6):448-454
pubmed: 25083161
Exp Biol Med (Maywood). 2020 Apr;245(7):597-605
pubmed: 32208974
Med Image Anal. 2019 Apr;53:123-131
pubmed: 30769327
Biomed Opt Express. 2020 Sep 11;11(10):5518-5541
pubmed: 33149968
Elife. 2020 Jul 27;9:
pubmed: 32716843
Med Image Anal. 2017 Dec;42:60-88
pubmed: 28778026
Nat Methods. 2019 Jan;16(1):103-110
pubmed: 30559434
Cytometry A. 2020 Mar;97(3):308-319
pubmed: 31688997
J Control Release. 2018 Sep 28;286:451-459
pubmed: 30036545
J Microsc. 2012 Aug;247(2):119-36
pubmed: 22621335
ACS Photonics. 2020 Jan 15;7(1):68-79
pubmed: 35936550
Proc Natl Acad Sci U S A. 2020 Apr 28;117(17):9223-9231
pubmed: 32284403
IEEE Trans Med Imaging. 2018 Jun;37(6):1464-1477
pubmed: 29870374
Invest Ophthalmol Vis Sci. 2016 Jul 1;57(9):OCTi-OCTii
pubmed: 27419359
Nat Commun. 2020 Apr 22;11(1):1934
pubmed: 32321916
Gastroenterology. 2020 Jan;158(1):76-94.e2
pubmed: 31593701
BBA Clin. 2017 Apr 27;8:7-13
pubmed: 28567338
Sci Rep. 2015 May 20;5:9848
pubmed: 25993434
Nat Biomed Eng. 2019 Jun;3(6):466-477
pubmed: 31142829
Proc Natl Acad Sci U S A. 1992 Feb 15;89(4):1271-5
pubmed: 1741380
Nat Methods. 2017 Apr;14(4):403-406
pubmed: 28218899
BME Front. 2020 Aug 25;2020:9647163
pubmed: 37849966
Ann Biomed Eng. 2012 Feb;40(2):304-31
pubmed: 22273730
Biomed Opt Express. 2017 Jun 16;8(7):3292-3316
pubmed: 28717568
J Invest Dermatol. 2020 Jun;140(6):1214-1222
pubmed: 31838127
J Biomed Opt. 2007 Sep-Oct;12(5):051403
pubmed: 17994864
Br J Ophthalmol. 2021 Aug;105(8):1133-1139
pubmed: 32907811
Biomed Opt Express. 2015 Nov 17;6(12):4887-98
pubmed: 26713202
Neurophotonics. 2018 Jan;5(1):011008
pubmed: 28924568
Nat Methods. 2018 Nov;15(11):917-920
pubmed: 30224672
Light Sci Appl. 2019 Mar 6;8:26
pubmed: 30854198
Biomed Opt Express. 2018 Aug 29;9(9):4509-4526
pubmed: 30615698
Optica. 2019 May;6(5):618-619
pubmed: 34350313
Annu Int Conf IEEE Eng Med Biol Soc. 2019 Jul;2019:4754-4757
pubmed: 31946924
Biomed Opt Express. 2018 May 16;9(6):2681-2698
pubmed: 30258683
Eur Heart J. 2010 Feb;31(4):401-15
pubmed: 19892716
Med Image Anal. 2018 Aug;48:162-176
pubmed: 29933116
Opt Lett. 2020 Jul 15;45(14):3897-3900
pubmed: 32667313
Photoacoustics. 2020 May 21;19:100190
pubmed: 32617261
Appl Opt. 2003 Sep 1;42(25):5181-90
pubmed: 12962399
Int J Comput Assist Radiol Surg. 2019 Nov;14(11):1837-1845
pubmed: 31129859
Front Neurosci. 2020 Sep 03;14:931
pubmed: 33013309
Opt Lett. 2019 Apr 15;44(8):1892-1895
pubmed: 30985768
Science. 2015 Jul 17;349(6245):255-60
pubmed: 26185243
IEEE Trans Ultrason Ferroelectr Freq Control. 2020 Dec;67(12):2649-2659
pubmed: 31944951
Inverse Probl Sci Eng. 2018 Sep 11;27(7):987-1005
pubmed: 31057659
Nat Methods. 2019 Jan;16(1):67-70
pubmed: 30559429
Phys Med Biol. 2014 Jan 6;59(1):R1-64
pubmed: 24334634
J Biomed Opt. 2018 Apr;23(4):1-10
pubmed: 29701018
Nat Med. 2018 Sep;24(9):1342-1350
pubmed: 30104768
IEEE Trans Med Imaging. 2020 Jun;39(6):1988-1999
pubmed: 31899416
Light Sci Appl. 2018 Oct 3;7:69
pubmed: 30302240
Proc Natl Acad Sci U S A. 2020 Dec 29;117(52):33051-33060
pubmed: 33318169
NPJ Precis Oncol. 2019 Dec 17;3:33
pubmed: 31872065
J Biophotonics. 2018 Jan;11(1):
pubmed: 28464457
Biomed Opt Express. 2018 Mar 08;9(4):1601-1612
pubmed: 29675305
Neuroimage. 2016 Apr 1;129:292-307
pubmed: 26774612
Biophys Rev. 2019 Feb;11(1):111-118
pubmed: 30182201
Med Phys. 2019 Nov;46(11):4763-4776
pubmed: 31132144
J Biophotonics. 2019 Mar;12(3):e201800185
pubmed: 30421551
Neurosci Biobehav Rev. 2017 Mar;74(Pt A):58-75
pubmed: 28087243
Opt Express. 2007 May 28;15(11):6696-716
pubmed: 19546980
NPJ Digit Med. 2020 May 18;3:73
pubmed: 32435701
Sci Rep. 2019 Nov 15;9(1):16912
pubmed: 31729459
Biomed Opt Express. 2018 Jun 25;9(7):3244-3265
pubmed: 29984096
J Biomed Opt. 2009 Mar-Apr;14(2):024012
pubmed: 19405742
Gut. 2019 Jan;68(1):94-100
pubmed: 29066576
Med Image Anal. 2019 May;54:100-110
pubmed: 30856455
Med Phys. 2019 Sep;46(9):4046-4056
pubmed: 31315162
J Biomed Opt. 2017 Nov;22(11):1-7
pubmed: 29098811
Nat Commun. 2017 Sep 6;8(1):463
pubmed: 28878212
Sci Rep. 2019 Mar 8;9(1):3926
pubmed: 30850721
Biomed Opt Express. 2020 Sep 02;11(10):5401-5424
pubmed: 33149959
J Biomed Opt. 2020 May;25(7):1-43
pubmed: 32406215
Comput Biol Med. 2019 Aug;111:103355
pubmed: 31323603
Proc Natl Acad Sci U S A. 2019 Nov 26;116(48):24019-24030
pubmed: 31719196