Generalization optimizing machine learning to improve CT scan radiomics and assess immune checkpoint inhibitors' response in non-small cell lung cancer: a multicenter cohort study.

DeepRadiomics Deeplearning NSCLC immunotherapy radiomics

Journal

Frontiers in oncology
ISSN: 2234-943X
Titre abrégé: Front Oncol
Pays: Switzerland
ID NLM: 101568867

Informations de publication

Date de publication:
2023
Historique:
received: 29 03 2023
accepted: 28 06 2023
medline: 7 8 2023
pubmed: 7 8 2023
entrez: 7 8 2023
Statut: epublish

Résumé

Recent developments in artificial intelligence suggest that radiomics may represent a promising non-invasive biomarker to predict response to immune checkpoint inhibitors (ICIs). Nevertheless, validation of radiomics algorithms in independent cohorts remains a challenge due to variations in image acquisition and reconstruction. Using radiomics, we investigated the importance of scan normalization as part of a broader machine learning framework to enable model external generalizability to predict ICI response in non-small cell lung cancer (NSCLC) patients across different centers. Radiomics features were extracted and compared from 642 advanced NSCLC patients on pre-ICI scans using established open-source PyRadiomics and a proprietary DeepRadiomics deep learning technology. The population was separated into two groups: a discovery cohort of 512 NSCLC patients from three academic centers and a validation cohort that included 130 NSCLC patients from a fourth center. We harmonized images to account for variations in reconstruction kernel, slice thicknesses, and device manufacturers. Multivariable models, evaluated using cross-validation, were used to estimate the predictive value of clinical variables, PD-L1 expression, and PyRadiomics or DeepRadiomics for progression-free survival at 6 months (PFS-6). The best prognostic factor for PFS-6, excluding radiomics features, was obtained with the combination of Clinical + PD-L1 expression (AUC = 0.66 in the discovery and 0.62 in the validation cohort). Without image harmonization, combining Clinical + PyRadiomics or DeepRadiomics delivered an AUC = 0.69 and 0.69, respectively, in the discovery cohort, but dropped to 0.57 and 0.52, in the validation cohort. This lack of generalizability was consistent with observations in principal component analysis clustered by CT scan parameters. Subsequently, image harmonization eliminated these clusters. The combination of Clinical + DeepRadiomics reached an AUC = 0.67 and 0.63 in the discovery and validation cohort, respectively. Conversely, the combination of Clinical + PyRadiomics failed generalizability validations, with AUC = 0.66 and 0.59. We demonstrated that a risk prediction model combining Clinical + DeepRadiomics was generalizable following CT scan harmonization and machine learning generalization methods. These results had similar performances to routine oncology practice using Clinical + PD-L1. This study supports the strong potential of radiomics as a future non-invasive strategy to predict ICI response in advanced NSCLC.

Sections du résumé

Background UNASSIGNED
Recent developments in artificial intelligence suggest that radiomics may represent a promising non-invasive biomarker to predict response to immune checkpoint inhibitors (ICIs). Nevertheless, validation of radiomics algorithms in independent cohorts remains a challenge due to variations in image acquisition and reconstruction. Using radiomics, we investigated the importance of scan normalization as part of a broader machine learning framework to enable model external generalizability to predict ICI response in non-small cell lung cancer (NSCLC) patients across different centers.
Methods UNASSIGNED
Radiomics features were extracted and compared from 642 advanced NSCLC patients on pre-ICI scans using established open-source PyRadiomics and a proprietary DeepRadiomics deep learning technology. The population was separated into two groups: a discovery cohort of 512 NSCLC patients from three academic centers and a validation cohort that included 130 NSCLC patients from a fourth center. We harmonized images to account for variations in reconstruction kernel, slice thicknesses, and device manufacturers. Multivariable models, evaluated using cross-validation, were used to estimate the predictive value of clinical variables, PD-L1 expression, and PyRadiomics or DeepRadiomics for progression-free survival at 6 months (PFS-6).
Results UNASSIGNED
The best prognostic factor for PFS-6, excluding radiomics features, was obtained with the combination of Clinical + PD-L1 expression (AUC = 0.66 in the discovery and 0.62 in the validation cohort). Without image harmonization, combining Clinical + PyRadiomics or DeepRadiomics delivered an AUC = 0.69 and 0.69, respectively, in the discovery cohort, but dropped to 0.57 and 0.52, in the validation cohort. This lack of generalizability was consistent with observations in principal component analysis clustered by CT scan parameters. Subsequently, image harmonization eliminated these clusters. The combination of Clinical + DeepRadiomics reached an AUC = 0.67 and 0.63 in the discovery and validation cohort, respectively. Conversely, the combination of Clinical + PyRadiomics failed generalizability validations, with AUC = 0.66 and 0.59.
Conclusion UNASSIGNED
We demonstrated that a risk prediction model combining Clinical + DeepRadiomics was generalizable following CT scan harmonization and machine learning generalization methods. These results had similar performances to routine oncology practice using Clinical + PD-L1. This study supports the strong potential of radiomics as a future non-invasive strategy to predict ICI response in advanced NSCLC.

Identifiants

pubmed: 37546399
doi: 10.3389/fonc.2023.1196414
pmc: PMC10400292
doi:

Types de publication

Journal Article

Langues

eng

Pagination

1196414

Informations de copyright

Copyright © 2023 Tonneau, Phan, Manem, Low-Kam, Dutil, Kazandjian, Vanderweyen, Panasci, Malo, Coulombe, Gagné, Elkrief, Belkaïd, Di Jorio, Orain, Bouchard, Muanza, Rybicki, Kafi, Huntsman, Joubert, Chandelier and Routy.

Déclaration de conflit d'intérêts

Author BR reports research funding with the company Imagia. Authors KP, CL-K, FD, LJ, FR, KK, DH, and FIC were Imagia employees at the time of the study. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Références

Eur J Cancer. 2019 Oct;120:65-74
pubmed: 31493723
Radiology. 2016 Feb;278(2):563-77
pubmed: 26579733
J Immunother Cancer. 2022 Jul;10(7):
pubmed: 35793875
Radiology. 2020 May;295(2):328-338
pubmed: 32154773
Nat Commun. 2022 Jun 14;13(1):3423
pubmed: 35701415
Lancet Oncol. 2018 Sep;19(9):1180-1191
pubmed: 30120041
Comput Math Methods Med. 2016;2016:2962047
pubmed: 27974907
Methods. 2021 Apr;188:20-29
pubmed: 32504782
Nat Cancer. 2022 Oct;3(10):1151-1164
pubmed: 36038778
J Clin Oncol. 2021 Jul 20;39(21):2339-2349
pubmed: 33872070
Phys Med Biol. 2020 Dec 17;65(24):24TR02
pubmed: 32688357
Eur J Cancer. 2009 Jan;45(2):228-47
pubmed: 19097774
Ann Oncol. 2021 Jul;32(7):881-895
pubmed: 33894335
Radiology. 2018 Aug;288(2):407-415
pubmed: 29688159
Acad Radiol. 2007 Dec;14(12):1455-63
pubmed: 18035275
Front Oncol. 2022 Feb 17;12:773840
pubmed: 35251962
Sci Rep. 2017 Jul 14;7(1):5467
pubmed: 28710497
Front Bioinform. 2022 Jun 27;2:927312
pubmed: 36304293
Sci Rep. 2022 Mar 16;12(1):4493
pubmed: 35296726
J Clin Oncol. 2020 May 10;38(14):1505-1517
pubmed: 32150489
Nat Commun. 2014 Jun 03;5:4006
pubmed: 24892406
N Engl J Med. 2019 Nov 21;381(21):2020-2031
pubmed: 31562796
N Engl J Med. 2018 May 31;378(22):2078-2092
pubmed: 29658856
Sci Rep. 2020 Jun 24;10(1):10248
pubmed: 32581221
J Clin Med. 2022 Mar 21;11(6):
pubmed: 35330068
J Clin Oncol. 2018 Mar 1;36(7):633-641
pubmed: 29337640
Ann Oncol. 2017 Jun 1;28(6):1191-1206
pubmed: 28168275
J Nucl Med. 2022 Feb;63(2):172-179
pubmed: 34531263
Sci Rep. 2016 Oct 10;6:34921
pubmed: 27721474

Auteurs

Marion Tonneau (M)

Department of Cancer Research, Centre de Recherche du Centre Hospitalier Universitaire de Montréal (CRCHUM), Montreal, QC, Canada.
Université de Médecine, Lille, France.

Kim Phan (K)

Imagia Canexia Health, Montreal, QC, Canada.

Venkata S K Manem (VSK)

Institut Universitaire de Cardiologie et de Pneumologie de Quebec, Université Laval, Québec City, QC, Canada.
Department of Mathematics and Computer Science, University of Quebec at Trois-Rivières, Trois-Rivières, QC, Canada.

Cecile Low-Kam (C)

Imagia Canexia Health, Montreal, QC, Canada.

Francis Dutil (F)

Imagia Canexia Health, Montreal, QC, Canada.

Suzanne Kazandjian (S)

Department of Medical Oncology, Jewish General Hospital, Montreal, QC, Canada.

Davy Vanderweyen (D)

Department of Radiology, Centre Hospitalier de Sherbrooke (CHUS), Sherbrooke, QC, Canada.

Justin Panasci (J)

Department of Medical Oncology, Jewish General Hospital, Montreal, QC, Canada.

Julie Malo (J)

Department of Cancer Research, Centre de Recherche du Centre Hospitalier Universitaire de Montréal (CRCHUM), Montreal, QC, Canada.

François Coulombe (F)

Institut Universitaire de Cardiologie et de Pneumologie de Quebec, Université Laval, Québec City, QC, Canada.

Andréanne Gagné (A)

Institut Universitaire de Cardiologie et de Pneumologie de Quebec, Université Laval, Québec City, QC, Canada.

Arielle Elkrief (A)

Department of Cancer Research, Centre de Recherche du Centre Hospitalier Universitaire de Montréal (CRCHUM), Montreal, QC, Canada.
Hemato-Oncology Division, Centre Hospitalier de l'université de Montreal, Montreal, QC, Canada.

Wiam Belkaïd (W)

Department of Cancer Research, Centre de Recherche du Centre Hospitalier Universitaire de Montréal (CRCHUM), Montreal, QC, Canada.

Lisa Di Jorio (L)

Imagia Canexia Health, Montreal, QC, Canada.

Michele Orain (M)

Institut Universitaire de Cardiologie et de Pneumologie de Quebec, Université Laval, Québec City, QC, Canada.

Nicole Bouchard (N)

Department of Oncology, Centre Hospitalier de Sherbrooke (CHUS), Sherbrooke, QC, Canada.

Thierry Muanza (T)

Department of Medical Oncology, Jewish General Hospital, Montreal, QC, Canada.
Department of Radiation Oncology, Lady Davis Institute of the Jewish General Hospital, Montreal, QC, Canada.

Frank J Rybicki (FJ)

Imagia Canexia Health, Montreal, QC, Canada.

Kam Kafi (K)

Imagia Canexia Health, Montreal, QC, Canada.

David Huntsman (D)

Imagia Canexia Health, Montreal, QC, Canada.

Philippe Joubert (P)

Institut Universitaire de Cardiologie et de Pneumologie de Quebec, Université Laval, Québec City, QC, Canada.
Department of Pathology, Institut Universitaire de Cardiologie et de Pneumologie de Québec, Québec, QC, Canada.

Florent Chandelier (F)

Imagia Canexia Health, Montreal, QC, Canada.

Bertrand Routy (B)

Department of Cancer Research, Centre de Recherche du Centre Hospitalier Universitaire de Montréal (CRCHUM), Montreal, QC, Canada.
Hemato-Oncology Division, Centre Hospitalier de l'université de Montreal, Montreal, QC, Canada.

Classifications MeSH