Machine learning does not outperform traditional statistical modelling for kidney allograft failure prediction.


Journal

Kidney international
ISSN: 1523-1755
Titre abrégé: Kidney Int
Pays: United States
ID NLM: 0323470

Informations de publication

Date de publication:
05 2023
Historique:
received: 14 06 2022
revised: 04 11 2022
accepted: 15 12 2022
medline: 25 4 2023
pubmed: 27 12 2022
entrez: 26 12 2022
Statut: ppublish

Résumé

Machine learning (ML) models have recently shown potential for predicting kidney allograft outcomes. However, their ability to outperform traditional approaches remains poorly investigated. Therefore, using large cohorts of kidney transplant recipients from 14 centers worldwide, we developed ML-based prediction models for kidney allograft survival and compared their prediction performances to those achieved by a validated Cox-Based Prognostication System (CBPS). In a French derivation cohort of 4000 patients, candidate determinants of allograft failure including donor, recipient and transplant-related parameters were used as predictors to develop tree-based models (RSF, RSF-ERT, CIF), Support Vector Machine models (LK-SVM, AK-SVM) and a gradient boosting model (XGBoost). Models were externally validated with cohorts of 2214 patients from Europe, 1537 from North America, and 671 from South America. Among these 8422 kidney transplant recipients, 1081 (12.84%) lost their grafts after a median post-transplant follow-up time of 6.25 years (Inter Quartile Range 4.33-8.73). At seven years post-risk evaluation, the ML models achieved a C-index of 0.788 (95% bootstrap percentile confidence interval 0.736-0.833), 0.779 (0.724-0.825), 0.786 (0.735-0.832), 0.527 (0.456-0.602), 0.704 (0.648-0.759) and 0.767 (0.711-0.815) for RSF, RSF-ERT, CIF, LK-SVM, AK-SVM and XGBoost respectively, compared with 0.808 (0.792-0.829) for the CBPS. In validation cohorts, ML models' discrimination performances were in a similar range of those of the CBPS. Calibrations of the ML models were similar or less accurate than those of the CBPS. Thus, when using a transparent methodological pipeline in validated international cohorts, ML models, despite overall good performances, do not outperform a traditional CBPS in predicting kidney allograft failure. Hence, our current study supports the continued use of traditional statistical approaches for kidney graft prognostication.

Identifiants

pubmed: 36572246
pii: S0085-2538(22)01084-5
doi: 10.1016/j.kint.2022.12.011
pii:
doi:

Types de publication

Journal Article Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

936-948

Commentaires et corrections

Type : CommentIn

Informations de copyright

Copyright © 2022 International Society of Nephrology. Published by Elsevier Inc. All rights reserved.

Auteurs

Agathe Truchot (A)

Université de Paris, INSERM, PARCC, Paris Translational Research Centre for Organ Transplantation, Paris, France.

Marc Raynaud (M)

Université de Paris, INSERM, PARCC, Paris Translational Research Centre for Organ Transplantation, Paris, France.

Nassim Kamar (N)

Université Paul Sabatier, INSERM, Department of Nephrology and Organ Transplantation, CHU Rangueil and Purpan, Toulouse, France.

Maarten Naesens (M)

Department of Microbiology, Immunology and Transplantation, KU Leuven, Leuven, Belgium.

Christophe Legendre (C)

Université de Paris, INSERM, PARCC, Paris Translational Research Centre for Organ Transplantation, Paris, France; Kidney Transplant Department, Necker Hospital, Assistance Publique-Hôpitaux de Paris, Paris, France.

Michel Delahousse (M)

Department of Transplantation, Nephrology and Clinical Immunology, Foch Hospital, Suresnes, France.

Olivier Thaunat (O)

Department of Transplantation, Nephrology and Clinical Immunology, Hospices Civils de Lyon, Lyon, France.

Matthias Buchler (M)

Nephrology and Immunology Department, Bretonneau Hospital, Tours, France.

Marta Crespo (M)

Department of Nephrology, Hospital del Mar Barcelona, Barcelona, Spain.

Kamilla Linhares (K)

Hospital do Rim, Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, Brazil.

Babak J Orandi (BJ)

University of Alabama at Birmingham Heersink School of Medicine, Birmingham, Alabama, USA.

Enver Akalin (E)

Renal Division, Montefiore Medical Centre, Kidney Transplantation Program, Albert Einstein College of Medicine, New York, New York, USA.

Gervacio Soler Pujol (GS)

Unidad de Trasplante Renopancreas, Centro de Educacion Medica e Investigaciones Clinicas Buenos Aires, Buenos Aires, Argentina.

Helio Tedesco Silva (HT)

Hospital do Rim, Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, Brazil.

Gaurav Gupta (G)

Division of Nephrology, Department of Internal Medicine, Virginia Commonwealth University School of Medicine, Richmond, Virginia, USA.

Dorry L Segev (DL)

Department of Surgery, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA.

Xavier Jouven (X)

Université de Paris, INSERM, PARCC, Paris Translational Research Centre for Organ Transplantation, Paris, France; Cardiology Department, European Georges Pompidou Hospital, Paris, France.

Andrew J Bentall (AJ)

William J von Liebig Centre for Transplantation and Clinical Regeneration, Mayo Clinic, Rochester, Minnesota, USA.

Mark D Stegall (MD)

William J von Liebig Centre for Transplantation and Clinical Regeneration, Mayo Clinic, Rochester, Minnesota, USA.

Carmen Lefaucheur (C)

Université de Paris, INSERM, PARCC, Paris Translational Research Centre for Organ Transplantation, Paris, France; Kidney Transplant Department, Saint-Louis Hospital, Assistance Publique-Hôpitaux de Paris, Paris, France.

Olivier Aubert (O)

Université de Paris, INSERM, PARCC, Paris Translational Research Centre for Organ Transplantation, Paris, France; Kidney Transplant Department, Necker Hospital, Assistance Publique-Hôpitaux de Paris, Paris, France.

Alexandre Loupy (A)

Université de Paris, INSERM, PARCC, Paris Translational Research Centre for Organ Transplantation, Paris, France; Kidney Transplant Department, Necker Hospital, Assistance Publique-Hôpitaux de Paris, Paris, France. Electronic address: alexandre.loupy@inserm.fr.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH