Embryo selection through artificial intelligence versus embryologists: a systematic review.
ART
IVF
artificial intelligence
embryo
embryo selection
embryology
machine learning
Journal
Human reproduction open
ISSN: 2399-3529
Titre abrégé: Hum Reprod Open
Pays: England
ID NLM: 101722764
Informations de publication
Date de publication:
2023
2023
Historique:
received:
08
03
2023
revised:
17
07
2023
medline:
17
8
2023
pubmed:
17
8
2023
entrez:
17
8
2023
Statut:
epublish
Résumé
What is the present performance of artificial intelligence (AI) decision support during embryo selection compared to the standard embryo selection by embryologists? AI consistently outperformed the clinical teams in all the studies focused on embryo morphology and clinical outcome prediction during embryo selection assessment. The ART success rate is ∼30%, with a worrying trend of increasing female age correlating with considerably worse results. As such, there have been ongoing efforts to address this low success rate through the development of new technologies. With the advent of AI, there is potential for machine learning to be applied in such a manner that areas limited by human subjectivity, such as embryo selection, can be enhanced through increased objectivity. Given the potential of AI to improve IVF success rates, it remains crucial to review the performance between AI and embryologists during embryo selection. The search was done across PubMed, EMBASE, Ovid Medline, and IEEE Xplore from 1 June 2005 up to and including 7 January 2022. Included articles were also restricted to those written in English. Search terms utilized across all databases for the study were: ('Artificial intelligence' OR 'Machine Learning' OR 'Deep learning' OR 'Neural network') AND ('IVF' OR ' A literature search was conducted for literature relating to AI applications to IVF. Primary outcomes of interest were accuracy, sensitivity, and specificity of the embryo morphology grade assessments and the likelihood of clinical outcomes, such as clinical pregnancy after IVF treatments. Risk of bias was assessed using the Modified Down and Black Checklist. Twenty articles were included in this review. There was no specific embryo assessment day across the studies-Day 1 until Day 5/6 of embryo development was investigated. The types of input for training AI algorithms were images and time-lapse (10/20), clinical information (6/20), and both images and clinical information (4/20). Each AI model demonstrated promise when compared to an embryologist's visual assessment. On average, the models predicted the likelihood of successful clinical pregnancy with greater accuracy than clinical embryologists, signifying greater reliability when compared to human prediction. The AI models performed at a median accuracy of 75.5% (range 59-94%) on predicting embryo morphology grade. The correct prediction (Ground Truth) was defined through the use of embryo images according to post embryologists' assessment following local respective guidelines. Using blind test datasets, the embryologists' accuracy prediction was 65.4% (range 47-75%) with the same ground truth provided by the original local respective assessment. Similarly, AI models had a median accuracy of 77.8% (range 68-90%) in predicting clinical pregnancy through the use of patient clinical treatment information compared to 64% (range 58-76%) when performed by embryologists. When both images/time-lapse and clinical information inputs were combined, the median accuracy by the AI models was higher at 81.5% (range 67-98%), while clinical embryologists had a median accuracy of 51% (range 43-59%). The findings of this review are based on studies that have not been prospectively evaluated in a clinical setting. Additionally, a fair comparison of all the studies were deemed unfeasible owing to the heterogeneity of the studies, development of the AI models, database employed and the study design and quality. AI provides considerable promise to the IVF field and embryo selection. However, there needs to be a shift in developers' perception of the clinical outcome from successful implantation towards ongoing pregnancy or live birth. Additionally, existing models focus on locally generated databases and many lack external validation. This study was funded by Monash Data Future Institute. All authors have no conflicts of interest to declare. CRD42021256333.
Identifiants
pubmed: 37588797
doi: 10.1093/hropen/hoad031
pii: hoad031
pmc: PMC10426717
doi:
Types de publication
Journal Article
Langues
eng
Pagination
hoad031Commentaires et corrections
Type : CommentIn
Informations de copyright
© The Author(s) 2023. Published by Oxford University Press on behalf of European Society of Human Reproduction and Embryology.
Déclaration de conflit d'intérêts
This study was funded by Monash Data Future Institute. All authors have no conflicts of interest to declare.All authors declare that there is no conflict of interest.
Références
Sociol Health Illn. 2022 Feb;44(2):308-327
pubmed: 35076088
Radiology. 2020 Apr;295(1):4-15
pubmed: 32068507
Reprod Biomed Online. 2017 Nov;35(5):494-510
pubmed: 28784335
JAMA. 2015 Dec 22-29;314(24):2654-2662
pubmed: 26717030
J Assist Reprod Genet. 2021 Jul;38(7):1675-1689
pubmed: 34173914
BMJ Open. 2017 Jan 13;7(1):e013538
pubmed: 28087553
Hum Reprod. 2013 Dec;28(12):3215-21
pubmed: 24070998
J Assist Reprod Genet. 2021 Jul;38(7):1641-1646
pubmed: 33904010
Reprod Biomed Online. 2022 Oct;45(4):703-711
pubmed: 35989168
Aust N Z J Public Health. 2009 Aug;33(4):358-64
pubmed: 19689597
Emerg Top Life Sci. 2021 Dec 20;:
pubmed: 34927670
Comput Biol Med. 2019 Dec;115:103494
pubmed: 31630027
Chin Med J (Engl). 2018 Jun 05;131(11):1261-1267
pubmed: 29786036
Fertil Steril. 2019 Feb;111(2):318-326
pubmed: 30611557
Fertil Steril. 2013 Jun;99(7):2025-30
pubmed: 23454007
Reprod Biomed Online. 2021 Mar;42(3):521-528
pubmed: 33558172
J Ovarian Res. 2017 Jan 13;10(1):2
pubmed: 28086935
Reprod Fertil. 2021 Aug 23;2(3):C29-C34
pubmed: 35118395
Health Informatics J. 2020 Sep;26(3):1810-1826
pubmed: 31826687
Med Decis Making. 2015 Aug;35(6):714-25
pubmed: 24842951
Hum Reprod. 2016 Oct;31(10):2231-44
pubmed: 27609980
J Genet Couns. 2014 Apr;23(2):202-11
pubmed: 23949612
J Public Health Res. 2013 Dec 01;2(3):e28
pubmed: 25170499
Reprod Biomed Online. 2021 Nov;43(5):843-852
pubmed: 34521598
Hum Reprod Update. 2015 Jul-Aug;21(4):411-26
pubmed: 25801630
Reprod Biomed Online. 2020 Oct;41(4):585-593
pubmed: 32843306
Fertil Steril. 2010 Aug;94(3):1152-3
pubmed: 20580357
J Assist Reprod Genet. 2020 Oct;37(10):2359-2376
pubmed: 32654105
NeuroRehabilitation. 2013;32(1):95-102
pubmed: 23422462
Syst Rev. 2021 Mar 29;10(1):89
pubmed: 33781348
NPJ Digit Med. 2019 Apr 4;2:21
pubmed: 31304368
Commun Biol. 2021 Mar 26;4(1):415
pubmed: 33772211
Fertil Steril. 2006 Dec;86(6):1608-15
pubmed: 17074349
Reprod Biomed Online. 2020 Jan;40(1):61-70
pubmed: 31831370
Genome Med. 2019 Nov 19;11(1):70
pubmed: 31744524
Hum Reprod Open. 2023 Mar 01;2023(2):hoad007
pubmed: 36959890
Fertil Steril. 2021 Nov;116(5):1227-1235
pubmed: 34256948
JBRA Assist Reprod. 2017 Sep 1;21(3):222-229
pubmed: 28837032
Annu Int Conf IEEE Eng Med Biol Soc. 2009;2009:6214-7
pubmed: 19964898
Hum Reprod. 2003 Sep;18(9):1959-66
pubmed: 12923157
J Clin Med. 2022 Nov 29;11(23):
pubmed: 36498659
Reprod Biomed Online. 2022 Dec;45(6):1105-1117
pubmed: 36117079
Fertil Res Pract. 2020 Feb 19;6:2
pubmed: 32099657
Hum Reprod. 2019 Dec 1;34(12):2523-2532
pubmed: 31769477
Annu Int Conf IEEE Eng Med Biol Soc. 2019 Jul;2019:920-924
pubmed: 31946044
Reprod Biomed Online. 2021 Apr;42(4):709-716
pubmed: 33632655
Fertil Steril. 2020 Apr;113(4):781-787.e1
pubmed: 32228880
Sci Rep. 2020 Dec 1;10(1):20925
pubmed: 33262383
J Assist Reprod Genet. 2019 Dec;36(12):2447-2457
pubmed: 31786731
Reprod Biol Endocrinol. 2018 Dec 5;16(1):121
pubmed: 30518389
Hum Reprod. 2019 Dec 1;34(12):2349-2361
pubmed: 31812992
Lab Chip. 2019 Dec 21;19(24):4139-4145
pubmed: 31755505
NPJ Digit Med. 2022 Jan 10;5(1):2
pubmed: 35013569
Korean J Anesthesiol. 2018 Oct;71(5):353-360
pubmed: 30157585
Fertil Steril. 2022 Mar;117(3):528-535
pubmed: 34998577
Elife. 2020 Sep 15;9:
pubmed: 32930094
Insights Imaging. 2018 Aug;9(4):611-629
pubmed: 29934920
Radiol Artif Intell. 2021 Dec 15;4(1):e200231
pubmed: 35146431
JBRA Assist Reprod. 2020 May 01;24(2):135-142
pubmed: 32072802
Hum Reprod. 2022 Sep 30;37(10):2275-2290
pubmed: 35944167
J Assist Reprod Genet. 2012 Nov;29(11):1227-39
pubmed: 22976427
Rand Health Q. 2016 Jun 20;6(1):16
pubmed: 28083444
J Lipid Atheroscler. 2021 Sep;10(3):282-290
pubmed: 34621699
Sci Technol Human Values. 2023 Jan;48(1):212-233
pubmed: 36504522
Hum Reprod. 2020 Apr 28;35(4):770-784
pubmed: 32240301