An online framework for survival analysis: reframing Cox proportional hazards model for large data sets and neural networks.

Cox proportional hazards model Inference Large survival data sets Neural networks Stochastic gradient descent Streaming data

Journal

Biostatistics (Oxford, England)
ISSN: 1468-4357
Titre abrégé: Biostatistics
Pays: England
ID NLM: 100897327

Informations de publication

Date de publication:
26 Oct 2022
Historique:
received: 30 08 2021
revised: 25 07 2022
accepted: 17 08 2022
entrez: 26 10 2022
pubmed: 27 10 2022
medline: 27 10 2022
Statut: aheadofprint

Résumé

In many biomedical applications, outcome is measured as a "time-to-event" (e.g., disease progression or death). To assess the connection between features of a patient and this outcome, it is common to assume a proportional hazards model and fit a proportional hazards regression (or Cox regression). To fit this model, a log-concave objective function known as the "partial likelihood" is maximized. For moderate-sized data sets, an efficient Newton-Raphson algorithm that leverages the structure of the objective function can be employed. However, in large data sets this approach has two issues: (i) The computational tricks that leverage structure can also lead to computational instability; (ii) The objective function does not naturally decouple: Thus, if the data set does not fit in memory, the model can be computationally expensive to fit. This additionally means that the objective is not directly amenable to stochastic gradient-based optimization methods. To overcome these issues, we propose a simple, new framing of proportional hazards regression: This results in an objective function that is amenable to stochastic gradient descent. We show that this simple modification allows us to efficiently fit survival models with very large data sets. This also facilitates training complex, for example, neural-network-based, models with survival data.

Identifiants

pubmed: 36288541
pii: 6775140
doi: 10.1093/biostatistics/kxac039
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Subventions

Organisme : NIH HHS
ID : DP5OD019820
Pays : United States

Informations de copyright

© The Author 2022. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Auteurs

Aliasghar Tarkhan (A)

Department of Biostatistics, Hans Rosling Center for Population Health, Box 351617, University of Washington Seattle, WA 98195, USA.

Noah Simon (N)

Department of Biostatistics, Hans Rosling Center for Population Health, Box 351617, University of Washington Seattle, WA 98195, USA.

Classifications MeSH