Embedded deep learning in ophthalmology: making ophthalmic imaging smarter.
artificial intelligence
deep learning
embedded devices
medical devices
ophthalmic devices
ophthalmology
Journal
Therapeutic advances in ophthalmology
ISSN: 2515-8414
Titre abrégé: Ther Adv Ophthalmol
Pays: United States
ID NLM: 101728805
Informations de publication
Date de publication:
Historique:
received:
17
10
2018
accepted:
20
12
2018
entrez:
27
3
2019
pubmed:
27
3
2019
medline:
27
3
2019
Statut:
epublish
Résumé
Deep learning has recently gained high interest in ophthalmology due to its ability to detect clinically significant features for diagnosis and prognosis. Despite these significant advances, little is known about the ability of various deep learning systems to be embedded within ophthalmic imaging devices, allowing automated image acquisition. In this work, we will review the existing and future directions for 'active acquisition'-embedded deep learning, leading to as high-quality images with little intervention by the human operator. In clinical practice, the improved image quality should translate into more robust deep learning-based clinical diagnostics. Embedded deep learning will be enabled by the constantly improving hardware performance with low cost. We will briefly review possible computation methods in larger clinical systems. Briefly, they can be included in a three-layer framework composed of edge, fog, and cloud layers, the former being performed at a device level. Improved egde-layer performance via 'active acquisition' serves as an automatic data curation operator translating to better quality data in electronic health records, as well as on the cloud layer, for improved deep learning-based clinical data mining.
Identifiants
pubmed: 30911733
doi: 10.1177/2515841419827172
pii: 10.1177_2515841419827172
pmc: PMC6425531
doi:
Types de publication
Journal Article
Review
Langues
eng
Pagination
2515841419827172Déclaration de conflit d'intérêts
Conflict of interest statement: The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Références
Biomed Opt Express. 2018 Feb 13;9(3):1111-1129
pubmed: 29541507
IEEE Trans Pattern Anal Mach Intell. 2020 Nov;42(11):2944-2959
pubmed: 31095478
Biomed Opt Express. 2012 Mar 1;3(3):572-89
pubmed: 22435103
Optica. 2018 Sep 20;5(9):1027-1036
pubmed: 31745495
Am J Emerg Med. 2018 Aug;36(8):1518
pubmed: 29321116
JAMA. 2018 Sep 18;320(11):1101-1102
pubmed: 30178065
PLoS One. 2012;7(4):e34823
pubmed: 22536333
Biomed Opt Express. 2019 Jan 15;10(2):552-570
pubmed: 30800499
JAMA. 2017 Dec 12;318(22):2211-2223
pubmed: 29234807
Biomed Opt Express. 2016 Sep 13;7(10):3996-4006
pubmed: 27867710
Nat Commun. 2017 Jul 11;8:16131
pubmed: 28695909
Indian J Ophthalmol. 2018 Feb;66(2):233-237
pubmed: 29380765
Ophthalmologica. 2017;238(1-2):89-99
pubmed: 28675903
Biomed Opt Express. 2018 Feb 20;9(3):1232-1243
pubmed: 29541516
Med Phys. 2018 Jun 14;:
pubmed: 29901223
Science. 2018 Aug 17;361(6403):
pubmed: 30115781
Biomed Opt Express. 2018 Jun 20;9(7):3178-3192
pubmed: 29984092
Med Biol Eng Comput. 2018 Jun;56(6):1107-1113
pubmed: 29178064
Invest Ophthalmol Vis Sci. 2017 Apr 01;58(4):2430-2437
pubmed: 28448671
Biomed Opt Express. 2018 Apr 25;9(5):2336-2350
pubmed: 29760992
Biomed Opt Express. 2017 Jan 13;8(2):828-859
pubmed: 28270988
J R Soc Interface. 2018 Apr;15(141):
pubmed: 29618526
Ophthalmology. 2018 Sep;125(9):1362-1371
pubmed: 29573814
Nat Med. 2018 May;24(5):539-540
pubmed: 29736024
Transl Vis Sci Technol. 2017 Aug 15;6(4):16
pubmed: 28824827
Clin Ophthalmol. 2017 May 23;11:1015-1020
pubmed: 28579753
Bioinformatics. 2019 Jan 15;35(2):243-250
pubmed: 29982392
Int J Comput Assist Radiol Surg. 2018 Jun;13(6):759-767
pubmed: 29594853
Biomed Opt Express. 2012 Oct 1;3(10):2611-22
pubmed: 23082300
Health Inf Manag. 2018 Sep;47(3):103-105
pubmed: 29719995
Science. 2018 Jun 15;360(6394):1204-1210
pubmed: 29903970
J Innov Health Inform. 2017 Jun 23;24(2):862
pubmed: 28749321
Invest Ophthalmol Vis Sci. 2015 Apr;56(4):2522-30
pubmed: 25744974
JAMA Ophthalmol. 2014 May;132(5):640-4
pubmed: 24604415
IEEE Pulse. 2018 Sep-Oct;9(5):16-24
pubmed: 30273136
PLoS One. 2017 Aug 7;12(8):e0182598
pubmed: 28787015
J Am Med Inform Assoc. 2016 Sep;23(5):899-908
pubmed: 26911829
J Biomed Opt. 2015 Mar;20(3):036006
pubmed: 25751163
PLoS One. 2019 Apr 5;14(4):e0214875
pubmed: 30951547
IEEE Trans Image Process. 2018 Oct 01;:
pubmed: 30281451
IEEE J Biomed Health Inform. 2018 Sep;22(5):1589-1604
pubmed: 29989977
J Digit Imaging. 2018 Dec;31(6):869-878
pubmed: 29704086
J Biomed Opt. 2017 May 1;22(5):56006
pubmed: 28530012
Biomed Opt Express. 2014 Aug 06;5(9):2963-77
pubmed: 25401010
Med Image Anal. 2018 Aug;48:203-213
pubmed: 29966940
Am J Ophthalmol. 2018 Mar;187:108-116
pubmed: 29330062
NPJ Digit Med. 2018 Aug 28;1:39
pubmed: 31304320
Opt Express. 2012 Jul 2;20(14):15654-68
pubmed: 22772258
Clin Exp Ophthalmol. 2018 Mar;46(2):169-176
pubmed: 29280542
J Biomed Opt. 2016 Feb;21(2):26007
pubmed: 26882449
NPJ Digit Med. 2018 Aug 28;1:40
pubmed: 31304321
Front Public Health. 2018 Apr 03;6:99
pubmed: 29666789
Biomed Opt Express. 2012 Oct 1;3(10):2537-49
pubmed: 23082294
J Opt Soc Am A Opt Image Sci Vis. 2009 Jan;26(1):72-7
pubmed: 19109602
J Ophthalmic Vis Res. 2018 Jan-Mar;13(1):66-71
pubmed: 29403593
IEEE Trans Image Process. 2017 Sep;26(9):4509-4522
pubmed: 28641250
BMC Health Serv Res. 2016 Oct 22;16(1):611
pubmed: 27770792
Invest Ophthalmol Vis Sci. 2018 Jul 2;59(8):3189-3198
pubmed: 29971443
IEEE Trans Med Imaging. 2018 Feb;37(2):491-503
pubmed: 29035212
Acta Ophthalmol. 2018 Mar;96(2):e242-e246
pubmed: 28391622
J Biophotonics. 2017 Jun;10(6-7):830-839
pubmed: 27434875
PLoS One. 2016 Aug 30;11(8):e0162015
pubmed: 27574800
Int J Technol Assess Health Care. 2014 Jul;30(3):260-4
pubmed: 25096225
Med Image Comput Comput Assist Interv. 2014;17(Pt 1):650-7
pubmed: 25333174
Biomed Opt Express. 2017 Jul 18;8(8):3687-3699
pubmed: 29082103
Biomed Opt Express. 2017 Nov 16;8(12):5675-5687
pubmed: 29296496
Nat Biomed Eng. 2018 Mar;2(3):158-164
pubmed: 31015713
J Neurosci Methods. 2012 Nov 15;211(2):227-36
pubmed: 23000405
Eye (Lond). 2017 Jun;31(6):899-905
pubmed: 28211881
Magn Reson Imaging. 2018 Nov;53:20-27
pubmed: 29964184
Ophthalmol Retina. 2018 Jan;2(1):24-30
pubmed: 31047298
Transl Vis Sci Technol. 2018 Jul 09;7(4):2
pubmed: 30002949
Med Image Anal. 2017 Dec;42:60-88
pubmed: 28778026
Opt Express. 2018 Nov 12;26(23):30911-30929
pubmed: 30469982
N Engl J Med. 2018 Apr 5;378(14):1271-1273
pubmed: 29617592
Clin Exp Ophthalmol. 2019 Jan;47(1):128-139
pubmed: 30155978
IEEE Trans Biomed Eng. 2019 Mar;66(3):710-717
pubmed: 30004868
Med Image Anal. 2013 Dec;17(8):1073-94
pubmed: 23906631
Philos Ethics Humanit Med. 2006 Mar 17;1(1):E2
pubmed: 16759426
Prog Retin Eye Res. 2014 Jul;41:26-43
pubmed: 24704352
Biomed Opt Express. 2017 Feb 16;8(3):1549-1574
pubmed: 28663849
Transl Vis Sci Technol. 2018 Oct 01;7(5):21
pubmed: 30280006
Circ Res. 2018 Apr 27;122(9):1290-1301
pubmed: 29700073
Med Image Anal. 2017 Apr;37:129-145
pubmed: 28208100
Biomed Opt Express. 2017 Aug 01;8(9):3903-3917
pubmed: 29026678
Prog Retin Eye Res. 2019 Jan;68:1-30
pubmed: 30165239
JAAPA. 2018 Aug;31(8):34-38
pubmed: 30048353
J Telemed Telecare. 2019 Feb;25(2):106-122
pubmed: 29165005
Sci Rep. 2017 Dec 19;7(1):17816
pubmed: 29259224
J Biomed Opt. 2017 Dec;22(12):1-30
pubmed: 29260539
J Ophthalmol. 2017;2017:8209270
pubmed: 28740736
IEEE J Transl Eng Health Med. 2018 May 08;6:2100510
pubmed: 29805919
Nat Med. 2018 Sep;24(9):1342-1350
pubmed: 30104768
Nat Med. 2014 Sep;20(9):1074-8
pubmed: 25150497
Sci Rep. 2016 Jun 09;6:27620
pubmed: 27278853
Biomed Opt Express. 2018 Jan 11;9(2):591-602
pubmed: 29552396
Curr Eye Res. 2017 Apr;42(4):629-635
pubmed: 27767345
Expert Rev Med Devices. 2018 Jan;15(1):15-26
pubmed: 29243500
Biomed Opt Express. 2018 Aug 14;9(9):4246-4262
pubmed: 30615699
Prog Retin Eye Res. 2018 Nov;67:1-29
pubmed: 30076935
J Ophthalmol. 2017;2017:4526243
pubmed: 28396802
Opt Express. 2010 May 24;18(11):11772-84
pubmed: 20589038
IEEE Trans Med Imaging. 2017 Feb;36(2):407-421
pubmed: 27662673
Front Public Health. 2015 Apr 20;3:57
pubmed: 25941668
Ophthalmology. 2017 Dec;124(12):1726-1728
pubmed: 29157423
Sensors (Basel). 2017 Feb 10;17(2):
pubmed: 28208620