Development and validation of models for detection of postoperative infections using structured electronic health records data and machine learning.
Journal
Surgery
ISSN: 1532-7361
Titre abrégé: Surgery
Pays: United States
ID NLM: 0417347
Informations de publication
Date de publication:
02 2023
02 2023
Historique:
received:
05
07
2022
revised:
18
10
2022
accepted:
26
10
2022
pmc-release:
01
02
2024
pubmed:
6
12
2022
medline:
1
2
2023
entrez:
5
12
2022
Statut:
ppublish
Résumé
Postoperative infections constitute more than half of all postoperative complications. Surveillance of these complications is primarily done through manual chart review, which is time consuming, expensive, and typically only covers 10% to 15% of all operations. Automated surveillance would permit the timely evaluation of and reporting of all operations. The goal of this study was to develop and validate parsimonious, interpretable models for conducting surveillance of postoperative infections using structured electronic health records data. This was a retrospective study using 30,639 unique operations from 5 major hospitals between 2013 and 2019. Structured electronic health records data were linked to postoperative outcomes data from the American College of Surgeons National Surgical Quality Improvement Program. Predictors from the electronic health records included diagnoses, procedures, and medications. Infectious complications included surgical site infection, urinary tract infection, sepsis, and pneumonia within 30 days of surgery. The knockoff filter, a penalized regression technique that controls type I error, was applied for variable selection. Models were validated in a chronological held-out dataset. Seven percent of patients experienced at least one type of postoperative infection. Models selected contained between 4 and 8 variables and achieved >0.91 area under the receiver operating characteristic curve, >81% specificity, >87% sensitivity, >99% negative predictive value, and 10% to 15% positive predictive value in a held-out test dataset. Surveillance and reporting of postoperative infection rates can be implemented for all operations with high accuracy using electronic health records data and simple linear regression models.
Sections du résumé
BACKGROUND
Postoperative infections constitute more than half of all postoperative complications. Surveillance of these complications is primarily done through manual chart review, which is time consuming, expensive, and typically only covers 10% to 15% of all operations. Automated surveillance would permit the timely evaluation of and reporting of all operations.
METHODS
The goal of this study was to develop and validate parsimonious, interpretable models for conducting surveillance of postoperative infections using structured electronic health records data. This was a retrospective study using 30,639 unique operations from 5 major hospitals between 2013 and 2019. Structured electronic health records data were linked to postoperative outcomes data from the American College of Surgeons National Surgical Quality Improvement Program. Predictors from the electronic health records included diagnoses, procedures, and medications. Infectious complications included surgical site infection, urinary tract infection, sepsis, and pneumonia within 30 days of surgery. The knockoff filter, a penalized regression technique that controls type I error, was applied for variable selection. Models were validated in a chronological held-out dataset.
RESULTS
Seven percent of patients experienced at least one type of postoperative infection. Models selected contained between 4 and 8 variables and achieved >0.91 area under the receiver operating characteristic curve, >81% specificity, >87% sensitivity, >99% negative predictive value, and 10% to 15% positive predictive value in a held-out test dataset.
CONCLUSION
Surveillance and reporting of postoperative infection rates can be implemented for all operations with high accuracy using electronic health records data and simple linear regression models.
Identifiants
pubmed: 36470694
pii: S0039-6060(22)00930-8
doi: 10.1016/j.surg.2022.10.026
pmc: PMC10204069
mid: NIHMS1894265
pii:
doi:
Types de publication
Journal Article
Research Support, U.S. Gov't, P.H.S.
Langues
eng
Sous-ensembles de citation
IM
Pagination
464-471Subventions
Organisme : NLM NIH HHS
ID : L30 LM014131
Pays : United States
Organisme : NHLBI NIH HHS
ID : L40 HL154485
Pays : United States
Organisme : AHRQ HHS
ID : R01 HS027417
Pays : United States
Informations de copyright
Published by Elsevier Inc.
Références
J Stat Softw. 2010;33(1):1-22
pubmed: 20808728
Cancer. 1950 Jan;3(1):32-5
pubmed: 15405679
J Biomed Inform. 2017 Jul;71S:S39-S45
pubmed: 27404849
JAMA Surg. 2015 Jan;150(1):51-7
pubmed: 25426765
J Hosp Infect. 2006 Jan;62(1):71-9
pubmed: 16099539
Jt Comm J Qual Patient Saf. 2010 Sep;36(9):411-7
pubmed: 20873674
Am J Infect Control. 2018 Nov;46(11):1230-1235
pubmed: 29907448
Am J Infect Control. 2014 Mar;42(3):e33-6
pubmed: 24581026
PLoS One. 2016 May 27;11(5):e0155705
pubmed: 27232332
J Am Coll Surg. 2021 Jun;232(6):963-971.e1
pubmed: 33831539
Am J Infect Control. 2014 Dec;42(12):1291-5
pubmed: 25465259
Ann Surg. 2016 Jun;263(6):1039-41
pubmed: 27167560
Surgery. 2021 Feb;169(2):325-332
pubmed: 32933745
Infect Control Hosp Epidemiol. 2013 Oct;34(10):1094-8
pubmed: 24018927
Infect Control Hosp Epidemiol. 2011 Aug;32(8):757-62
pubmed: 21768758
Surgery. 2018 Dec;164(6):1300-1305
pubmed: 30056994
AMIA Annu Symp Proc. 2017 Feb 10;2016:1822-1831
pubmed: 28269941
Comput Methods Programs Biomed. 2018 Nov;166:51-59
pubmed: 30415718
Am J Infect Control. 2019 Apr;47(4):371-375
pubmed: 30522837
Med Care. 2013 Jun;51(6):509-16
pubmed: 23673394
Ann Intern Med. 2015 Jan 6;162(1):W1-73
pubmed: 25560730
AMIA Annu Symp Proc. 2018 Apr 16;2017:625-634
pubmed: 29854127
JAMA Intern Med. 2013 Dec 9-23;173(22):2039-46
pubmed: 23999949
Infect Control Hosp Epidemiol. 2015 Sep;36(9):1004-10
pubmed: 26022228
Am J Surg. 2020 Jul;220(1):114-119
pubmed: 31635792
BMC Bioinformatics. 2011 Mar 17;12:77
pubmed: 21414208
JMIR Med Inform. 2019 Nov 29;7(4):e14325
pubmed: 31553307
Stud Health Technol Inform. 2015;216:706-10
pubmed: 26262143
AMIA Annu Symp Proc. 2020 Mar 04;2019:1002-1010
pubmed: 32308897
Am J Infect Control. 2009 Jun;37(5):351-357
pubmed: 19201510
Infect Control Hosp Epidemiol. 2014 Jun;35(6):685-91
pubmed: 24799645
J Infect Public Health. 2014 Jul-Aug;7(4):339-44
pubmed: 24861643
Am J Infect Control. 2009 Jun;37(5):387-397
pubmed: 19398246
Am J Infect Control. 2018 Jul;46(7):743-746
pubmed: 29551201
JAMA. 2011 Aug 24;306(8):848-55
pubmed: 21862746
Med Care. 2009 Mar;47(3):364-9
pubmed: 19194330
PLoS One. 2017 Jul 7;12(7):e0175508
pubmed: 28686612
Am J Infect Control. 2015 Jun;43(6):592-9
pubmed: 25840717
AMIA Annu Symp Proc. 2018 Apr 16;2017:1507-1516
pubmed: 29854220
Clin Infect Dis. 2014 Mar;58(5):688-96
pubmed: 24218103