Surveillance of catheter-associated bloodstream infections: development and validation of a fully automated algorithm.
Bloodstream infection
CLABSI
Catheter-infection
Digital
Healthcare associated infections
Intensive care unit
Internal validation
Sensitivity
Specificity
Journal
Antimicrobial resistance and infection control
ISSN: 2047-2994
Titre abrégé: Antimicrob Resist Infect Control
Pays: England
ID NLM: 101585411
Informations de publication
Date de publication:
10 Apr 2024
10 Apr 2024
Historique:
received:
26
11
2023
accepted:
01
04
2024
medline:
11
4
2024
pubmed:
11
4
2024
entrez:
10
4
2024
Statut:
epublish
Résumé
Most surveillance systems for catheter-related bloodstream infections (CRBSI) and central line-associated bloodstream infections (CLABSI) are based on manual chart review. Our objective was to validate a fully automated algorithm for CRBSI and CLABSI surveillance in intensive care units (ICU). We developed a fully automated algorithm to detect CRBSI, CLABSI and ICU-onset bloodstream infections (ICU-BSI) in patients admitted to the ICU of a tertiary care hospital in Switzerland. The parameters included in the algorithm were based on a recently performed systematic review. Structured data on demographics, administrative data, central vascular catheter and microbiological results (blood cultures and other clinical cultures) obtained from the hospital's data warehouse were processed by the algorithm. Validation for CRBSI was performed by comparing results with prospective manual BSI surveillance data over a 6-year period. CLABSI were retrospectively assessed over a 2-year period. From January 2016 to December 2021, 854 positive blood cultures were identified in 346 ICU patients. The median age was 61.7 years [IQR 50-70]; 205 (24%) positive samples were collected from female patients. The algorithm detected 5 CRBSI, 109 CLABSI and 280 ICU-BSI. The overall CRBSI and CLABSI incidence rates determined by automated surveillance for the period 2016 to 2021 were 0.18/1000 catheter-days (95% CI 0.06-0.41) and 3.86/1000 catheter days (95% CI: 3.17-4.65). The sensitivity, specificity, positive predictive and negative predictive values of the algorithm for CRBSI, were 83% (95% CI 43.7-96.9), 100% (95% CI 99.5-100), 100% (95% CI 56.5-100), and 99.9% (95% CI 99.2-100), respectively. One CRBSI was misclassified as an ICU-BSI by the algorithm because the same bacterium was identified in the blood culture and in a lower respiratory tract specimen. Manual review of CLABSI from January 2020 to December 2021 (n = 51) did not identify any errors in the algorithm. A fully automated algorithm for CRBSI and CLABSI detection in critically-ill patients using only structured data provided valid results. The next step will be to assess the feasibility and external validity of implementing it in several hospitals with different electronic health record systems.
Sections du résumé
BACKGROUND
BACKGROUND
Most surveillance systems for catheter-related bloodstream infections (CRBSI) and central line-associated bloodstream infections (CLABSI) are based on manual chart review. Our objective was to validate a fully automated algorithm for CRBSI and CLABSI surveillance in intensive care units (ICU).
METHODS
METHODS
We developed a fully automated algorithm to detect CRBSI, CLABSI and ICU-onset bloodstream infections (ICU-BSI) in patients admitted to the ICU of a tertiary care hospital in Switzerland. The parameters included in the algorithm were based on a recently performed systematic review. Structured data on demographics, administrative data, central vascular catheter and microbiological results (blood cultures and other clinical cultures) obtained from the hospital's data warehouse were processed by the algorithm. Validation for CRBSI was performed by comparing results with prospective manual BSI surveillance data over a 6-year period. CLABSI were retrospectively assessed over a 2-year period.
RESULTS
RESULTS
From January 2016 to December 2021, 854 positive blood cultures were identified in 346 ICU patients. The median age was 61.7 years [IQR 50-70]; 205 (24%) positive samples were collected from female patients. The algorithm detected 5 CRBSI, 109 CLABSI and 280 ICU-BSI. The overall CRBSI and CLABSI incidence rates determined by automated surveillance for the period 2016 to 2021 were 0.18/1000 catheter-days (95% CI 0.06-0.41) and 3.86/1000 catheter days (95% CI: 3.17-4.65). The sensitivity, specificity, positive predictive and negative predictive values of the algorithm for CRBSI, were 83% (95% CI 43.7-96.9), 100% (95% CI 99.5-100), 100% (95% CI 56.5-100), and 99.9% (95% CI 99.2-100), respectively. One CRBSI was misclassified as an ICU-BSI by the algorithm because the same bacterium was identified in the blood culture and in a lower respiratory tract specimen. Manual review of CLABSI from January 2020 to December 2021 (n = 51) did not identify any errors in the algorithm.
CONCLUSIONS
CONCLUSIONS
A fully automated algorithm for CRBSI and CLABSI detection in critically-ill patients using only structured data provided valid results. The next step will be to assess the feasibility and external validity of implementing it in several hospitals with different electronic health record systems.
Identifiants
pubmed: 38600526
doi: 10.1186/s13756-024-01395-4
pii: 10.1186/s13756-024-01395-4
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
38Investigateurs
Carlo Balmelli
(C)
Delphine Berthod
(D)
Philipp Jent
(P)
Jonas Marschall
(J)
Hugo Sax
(H)
Matthias Schlegel
(M)
Alexander Schweiger
(A)
Laurence Senn
(L)
Rami Sommerstein
(R)
Sarah Tschudin-Sutter
(S)
Nicolas Troillet
(N)
Danielle Vuichard-Gysin
(D)
Andreas F Widmer
(AF)
Aline Wolfensberger
(A)
Walter Zingg
(W)
Informations de copyright
© 2024. The Author(s).
Références
Cassini A, Plachouras D, Eckmanns T, Abu Sin M, Blank HP, Ducomble T, et al. Burden of six healthcare-associated infections on European population health: estimating incidence-based disability-adjusted life years through a population prevalence-based modelling study. PLoS Med. 2016;13(10):e1002150.
doi: 10.1371/journal.pmed.1002150
pubmed: 27755545
pmcid: 5068791
Suetens C, Latour K, Kärki T, Ricchizzi E, Kinross P, Moro ML, et al. Prevalence of healthcare-associated infections, estimated incidence and composite antimicrobial resistance index in acute care hospitals and long-term care facilities: results from two European point prevalence surveys, 2016 to 2017. Euro Surveill. 2018;23(46):1800516.
doi: 10.2807/1560-7917.ES.2018.23.46.1800516
pubmed: 30458912
pmcid: 6247459
Schreiber PW, Sax H, Wolfensberger A, Clack L, Kuster SP, Swissnoso. The preventable proportion of healthcare-associated infections 2005–2016: systematic review and meta-analysis. Infect Control Hosp Epidemiol. 2018;39(11):1277–95.
doi: 10.1017/ice.2018.183
pubmed: 30234463
Healthcare-associated infections in intensive care units - Annual Epidemiological Report for 2017. 2019. https://www.ecdc.europa.eu/en/publications-data/healthcare-associated-infections-intensive-care-units-annual-epidemiological-1 . Cited 2023 Apr 5.
Tabah A, Buetti N, Staiquly Q, Ruckly S, Akova M, Aslan AT, et al. Epidemiology and outcomes of hospital-acquired bloodstream infections in intensive care unit patients: the EUROBACT-2 international cohort study. Intensive Care Med. 2023;49(2):178–90.
doi: 10.1007/s00134-022-06944-2
pubmed: 36764959
pmcid: 9916499
Rice S, Carr K, Sobiesuo P, Shabaninejad H, Orozco-Leal G, Kontogiannis V, et al. Economic evaluations of interventions to prevent and control health-care-associated infections: a systematic review. Lancet Infect Dis. 2023;S1473–3099(22):00877–5.
van Mourik MSM, van Rooden SM, Abbas M, Aspevall O, Astagneau P, Bonten MJM, et al. PRAISE: providing a roadmap for automated infection surveillance in Europe. Clin Microbiol Infect. 2021;27:S3–19.
doi: 10.1016/j.cmi.2021.02.028
pubmed: 34217466
van Mourik MSM, Perencevich EN, Gastmeier P, Bonten MJM. Designing surveillance of healthcare-associated infections in the era of automation and reporting mandates. Clin Infect Dis. 2018;66(6):970–6.
doi: 10.1093/cid/cix835
pubmed: 29514241
Metsini A, Widmer A, Zingg W, Gardiol C, Vuichard-Gysin D, Eder M, et al. Evaluation of existing and desired measures to monitor, prevent and control healthcare-associated infections in Swiss hospitals. Swiss Med Wkly. 2021;151:w20516.
doi: 10.4414/smw.2021.20516
pubmed: 34265072
Chopra V, Flanders SA, Saint S, Woller SC, O’Grady NP, Safdar N, et al. The Michigan Appropriateness Guide for Intravenous catheters (MAGIC): results from a multispecialty panel using the RAND/UCLA appropriateness method. Ann Intern Med. 2015;163(6 Suppl):S1-40.
doi: 10.7326/M15-0744
pubmed: 26369828
Zingg W, Sax H, Inan C, Cartier V, Diby M, Clergue F, et al. Hospital-wide surveillance of catheter-related bloodstream infection: from the expected to the unexpected. J Hosp Infect. 2009;73(1):41–6.
doi: 10.1016/j.jhin.2009.05.015
pubmed: 19646788
ECDC European Centre for Disease Prevention and Control. Point prevalence survey of healthcare-associated infections and antimicrobial use in European acute care hospitals – protocol version 6.1. 2022. Available from: https://www.ecdc.europa.eu/en/publications-data/point-prevalence-survey-healthcare-associated-infections-and-antimicrobial-use-vs-6-1 . Cited 2023 Mar 26.
Zingg W, Metsini A, Balmelli C, Neofytos D, Behnke M, Gardiol C, et al. National point prevalence survey on healthcare-associated infections in acute care hospitals, Switzerland, 2017. Euro Surveill. 2019;24(32):1800603.
doi: 10.2807/1560-7917.ES.2019.24.32.1800603
pubmed: 31411135
pmcid: 6693290
Plachouras D, Kärki T, Hansen S, Hopkins S, Lyytikäinen O, Moro ML, et al. Antimicrobial use in European acute care hospitals: results from the second point prevalence survey (PPS) of healthcare-associated infections and antimicrobial use, 2016 to 2017. Euro Surveill. 2018;23(46):1800393.
doi: 10.2807/1560-7917.ES.23.46.1800393
pubmed: 30458917
pmcid: 6247463
Brun-Buisson C, Abrouk F, Legrand P, Huet Y, Larabi S, Rapin M. Diagnosis of central venous catheter-related sepsis. Critical level of quantitative tip cultures. Arch Intern Med. 1987;147(5):873–7.
doi: 10.1001/archinte.1987.00370050069012
pubmed: 3555377
Januel JM, Lotfinejad N, Grant R, Tschudin-Sutter S, Schreiber PW, Grandbastien B, et al. Predictive performance of automated surveillance algorithms for intravascular catheter bloodstream infections: a systematic review and meta-analysis. Antimicrob Resist Infect Control. 2023;12(1):87. https://doi.org/10.1186/s13756-023-01286-0 .
NHSN organism category. 2023. Available from: https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=8&ved=2ahUKEwjsjev_sJ2AAxWh87sIHadrBNYQFnoECBQQAQ&url=https%3A%2F%2Fwww.cdc.gov%2Fnhsn%2Fxls%2Fmaster-organism-com-commensals-lists.xlsx&usg=AOvVaw0qQJtjvjzMdHD_7AspcekI&opi=89978449 .
de Grooth HJ, Timsit JF, Mermel L, Mimoz O, Buetti N, du Cheyron D, et al. Validity of surrogate endpoints assessing central venous catheter-related infection: evidence from individual- and study-level analyses. Clin Microbiol Infect. 2020;26(5):563–71.
doi: 10.1016/j.cmi.2019.09.022
pubmed: 31586658
Benchimol EI, Manuel DG, To T, Griffiths AM, Rabeneck L, Guttmann A. Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol. 2011;64(8):821–9.
doi: 10.1016/j.jclinepi.2010.10.006
pubmed: 21194889
Verberk JDM, Aghdassi SJS, Abbas M, Nauclér P, Gubbels S, Maldonado N, et al. Automated surveillance systems for healthcare-associated infections: results from a European survey and experiences from real-life utilization. J Hosp Infect. 2022;122:35–43.
doi: 10.1016/j.jhin.2021.12.021
pubmed: 35031393
Behnke M, Valik JK, Gubbels S, Teixeira D, Kristensen B, Abbas M, et al. Information technology aspects of large-scale implementation of automated surveillance of healthcare-associated infections. Clin Microbiol Infect. 2021;27(Suppl 1):S29–39.
doi: 10.1016/j.cmi.2021.02.027
pubmed: 34217465
Burgess A, van Diggele C, Roberts C, Mellis C. Feedback in the clinical setting. BMC Med Educ. 2020;20(Suppl 2). Available from: https://pubmed.ncbi.nlm.nih.gov/33272265/ . Cited 2023 Sep 21.
Haque M, McKimm J, Sartelli M, Dhingra S, Labricciosa FM, Islam S, et al. Strategies to prevent healthcare-associated infections: a narrative overview. Risk Manag Healthc Policy. 2020;13:1765–80.
doi: 10.2147/RMHP.S269315
pubmed: 33061710
pmcid: 7532064
Mauger B, Marbella A, Pines E, Chopra R, Black ER, Aronson N. Implementing quality improvement strategies to reduce healthcare-associated infections: a systematic review. Am J Infect Control. 2014;42(10):S274–83.
doi: 10.1016/j.ajic.2014.05.031
pubmed: 25239722
Branch-Elliman W, Strymish J, Kudesia V, Rosen AK, Gupta K. Natural language processing for real-time catheter-associated urinary tract infection surveillance: results of a pilot implementation trial. Infect Control Hosp Epidemiol. 2015;36(9):1004–10.
doi: 10.1017/ice.2015.122
pubmed: 26022228
Shenoy ES, Branch-Elliman W. Automating surveillance for healthcare-associated infections: Rationale and current realities (part I/III). Antimicrob Steward Healthc Epidemiol. 2023;3(1):e25.
doi: 10.1017/ash.2022.312
pubmed: 36865706
pmcid: 9972536
SPHN. SPHN - Swiss Personalized Health Network (SPHN). Available from: https://sphn.ch/ . Cited 2023 Nov 3.
European Center for Diseases Control. Healthcare-associated infections acquired in intensive care units Annual Epidemiological Report. 2019. https://www.ecdc.europa.eu/en/publications-data/healthcare-associated-infections-intensive-care-units-2019 .
Bisanti A, Giammatteo V, Bello G, Giannarelli D, Montini L, Tanzarella ES, et al. Usefulness of differential time to positivity between catheter and peripheral blood cultures for diagnosing catheter-related bloodstream infection: data analysis from routine clinical practice in the intensive care unit. J Crit Care. 2023;75:154259.
doi: 10.1016/j.jcrc.2023.154259
pubmed: 36706553