Computer vision in surgery: from potential to clinical value.


Journal

NPJ digital medicine
ISSN: 2398-6352
Titre abrégé: NPJ Digit Med
Pays: England
ID NLM: 101731738

Informations de publication

Date de publication:
28 Oct 2022
Historique:
received: 15 07 2022
accepted: 10 10 2022
pubmed: 29 10 2022
medline: 29 10 2022
entrez: 28 10 2022
Statut: epublish

Résumé

Hundreds of millions of operations are performed worldwide each year, and the rising uptake in minimally invasive surgery has enabled fiber optic cameras and robots to become both important tools to conduct surgery and sensors from which to capture information about surgery. Computer vision (CV), the application of algorithms to analyze and interpret visual data, has become a critical technology through which to study the intraoperative phase of care with the goals of augmenting surgeons' decision-making processes, supporting safer surgery, and expanding access to surgical care. While much work has been performed on potential use cases, there are currently no CV tools widely used for diagnostic or therapeutic applications in surgery. Using laparoscopic cholecystectomy as an example, we reviewed current CV techniques that have been applied to minimally invasive surgery and their clinical applications. Finally, we discuss the challenges and obstacles that remain to be overcome for broader implementation and adoption of CV in surgery.

Identifiants

pubmed: 36307544
doi: 10.1038/s41746-022-00707-5
pii: 10.1038/s41746-022-00707-5
pmc: PMC9616906
doi:

Types de publication

Journal Article Review

Langues

eng

Pagination

163

Subventions

Organisme : EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
ID : 813782
Organisme : Agence Nationale de la Recherche (French National Research Agency)
ID : ANR-20-CHIA-0029-01
Organisme : Agence Nationale de la Recherche (French National Research Agency)
ID : ANR-10-IAHU-02

Informations de copyright

© 2022. The Author(s).

Références

Surg Endosc. 2022 Nov;36(11):8379-8386
pubmed: 35171336
Ann Surg. 2021 Apr 1;273(4):684-693
pubmed: 33201088
Lancet Digit Health. 2022 May;4(5):e384-e397
pubmed: 35396183
Surg Endosc. 2012 Apr;26(4):1128-34
pubmed: 22044975
J Spine Surg. 2020 Jan;6(Suppl 1):S260-S274
pubmed: 32195433
Int J Comput Assist Radiol Surg. 2022 Nov;17(11):1991-1999
pubmed: 35643827
Int J Comput Assist Radiol Surg. 2019 Jun;14(6):1059-1067
pubmed: 30968356
Surg Endosc. 2013 Apr;27(4):1051-4
pubmed: 23355163
Ann Surg. 2021 Jan 15;:
pubmed: 33630449
Patient Saf Surg. 2011 May 20;5:13
pubmed: 21599915
Surg Endosc. 2021 Sep;35(9):4918-4929
pubmed: 34231065
Am J Surg. 2014 Oct;208(4):626-31
pubmed: 24953016
Surg Endosc. 2022 Feb;36(2):1090-1097
pubmed: 33616730
Nat Med. 2021 Jan;27(1):136-140
pubmed: 33442014
Ann Surg. 2022 Aug 1;276(2):363-369
pubmed: 33196488
Gastrointest Endosc. 2021 Jan;93(1):77-85.e6
pubmed: 32598963
Ann Surg. 2021 Jul 1;274(1):e93-e95
pubmed: 33417329
Surg Endosc. 2021 Apr;35(4):1651-1658
pubmed: 32306111
IEEE Trans Med Imaging. 2017 Jan;36(1):86-97
pubmed: 27455522
Int J Comput Assist Radiol Surg. 2021 Jan;16(1):103-113
pubmed: 33146850
Surg Endosc. 2021 Apr;35(4):1521-1533
pubmed: 33398560
Sci Rep. 2021 Mar 4;11(1):5197
pubmed: 33664317
J Am Coll Surg. 2021 Oct;233(4):497-505
pubmed: 34325017
Ann Surg. 2022 May 1;275(5):955-961
pubmed: 33201104
Eur Radiol. 2021 Jun;31(6):3797-3804
pubmed: 33856519
JAMA Surg. 2015 Feb;150(2):169-72
pubmed: 25548997
Ann Surg. 2013 Aug;258(2):270-4
pubmed: 23598378
IEEE Trans Med Imaging. 2020 Mar;39(3):556-566
pubmed: 31352339
Surgery. 2021 May;169(5):1253-1256
pubmed: 33272610
Surgery. 2015 Jul;158(1):3-6
pubmed: 25987187
Am J Surg. 2021 Jan;221(1):13-18
pubmed: 32665080
JAMA Surg. 2018 Apr 18;153(4):e176233
pubmed: 29490366
Surg Endosc. 2022 Nov;36(11):7938-7948
pubmed: 35556166
Ann Surg. 2003 Apr;237(4):460-9
pubmed: 12677139
J Surg Oncol. 2021 Aug;124(2):221-230
pubmed: 34245578
Surg Endosc. 2018 May;32(5):2175-2183
pubmed: 29556977
Surgery. 2022 May;171(5):1158-1167
pubmed: 34776259
Ann Surg. 2020 Jul;272(1):3-23
pubmed: 32404658
Surgery. 2006 Jul;140(1):25-33
pubmed: 16857439
Int J Comput Assist Radiol Surg. 2019 Jul;14(7):1167-1176
pubmed: 30989505
Comput Assist Surg (Abingdon). 2021 Dec;26(1):58-68
pubmed: 34126014
Med Image Anal. 2022 Feb;76:102306
pubmed: 34879287
Surg Endosc. 2021 Jul;35(7):4008-4015
pubmed: 32720177
IEEE Trans Med Imaging. 2019 Apr;38(4):1069-1078
pubmed: 30371356
Lancet Digit Health. 2022 Jun;4(6):e406-e414
pubmed: 35568690
J Surg Res. 2018 Mar;223:64-71
pubmed: 29433887
Br J Surg. 2019 Oct;106(11):1433-1441
pubmed: 31112294
Med Image Anal. 2022 May;78:102433
pubmed: 35398658
AMIA Annu Symp Proc. 2021 Jan 25;2020:1373-1382
pubmed: 34025905
Int J Comput Assist Radiol Surg. 2022 Jan;17(1):5-13
pubmed: 34297269
BMJ. 2012 Oct 11;345:e6457
pubmed: 23060654
Surg Endosc. 2022 Sep;36(9):6832-6840
pubmed: 35031869
Int J Comput Assist Radiol Surg. 2022 Mar;17(3):437-448
pubmed: 35103921
J Big Data. 2021;8(1):101
pubmed: 34306963
Nat Commun. 2020 Jul 22;11(1):3673
pubmed: 32699250
IEEE Trans Neural Netw Learn Syst. 2018 May;29(5):1675-1688
pubmed: 28333645
Med Image Anal. 2021 Oct;73:102158
pubmed: 34325149
Lancet. 2015 Apr 27;385 Suppl 2:S11
pubmed: 26313057
Nat Med. 2019 Jan;25(1):24-29
pubmed: 30617335
Surg Endosc. 2020 Aug;34(8):3285-3288
pubmed: 32415370
Radiol Artif Intell. 2020 May 27;2(3):e190043
pubmed: 32510054
N Engl J Med. 1991 Apr 18;324(16):1073-8
pubmed: 1826143
J Imaging. 2021 Jan 25;7(2):
pubmed: 34460614

Auteurs

Pietro Mascagni (P)

Gemelli Hospital, Catholic University of the Sacred Heart, Rome, Italy. pietro.mascagni@ihu-strasbourg.eu.
IHU-Strasbourg, Institute of Image-Guided Surgery, Strasbourg, France. pietro.mascagni@ihu-strasbourg.eu.
Global Surgical Artificial Intelligence Collaborative, Toronto, ON, Canada. pietro.mascagni@ihu-strasbourg.eu.

Deepak Alapatt (D)

ICube, University of Strasbourg, CNRS, IHU, Strasbourg, France.

Luca Sestini (L)

ICube, University of Strasbourg, CNRS, IHU, Strasbourg, France.
Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano, Italy.

Maria S Altieri (MS)

Global Surgical Artificial Intelligence Collaborative, Toronto, ON, Canada.
Department of Surgery, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.

Amin Madani (A)

Global Surgical Artificial Intelligence Collaborative, Toronto, ON, Canada.
Department of Surgery, University Health Network, Toronto, ON, Canada.

Yusuke Watanabe (Y)

Global Surgical Artificial Intelligence Collaborative, Toronto, ON, Canada.
Department of Surgery, University of Hokkaido, Hokkaido, Japan.

Adnan Alseidi (A)

Global Surgical Artificial Intelligence Collaborative, Toronto, ON, Canada.
Department of Surgery, University of California San Francisco, San Francisco, CA, USA.

Jay A Redan (JA)

Department of Surgery, AdventHealth-Celebration Health, Celebration, FL, USA.

Sergio Alfieri (S)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Guido Costamagna (G)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Ivo Boškoski (I)

Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy.

Nicolas Padoy (N)

IHU-Strasbourg, Institute of Image-Guided Surgery, Strasbourg, France.
ICube, University of Strasbourg, CNRS, IHU, Strasbourg, France.

Daniel A Hashimoto (DA)

Global Surgical Artificial Intelligence Collaborative, Toronto, ON, Canada.
Department of Surgery, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.

Classifications MeSH