Utility of the American College of Surgeons National Surgical Quality Improvement Program surgical risk calculator in predicting mortality in an Australian acute surgical unit.
National Surgical Quality Improvement Program
emergency
general surgery
mortality
risk calculator
Journal
ANZ journal of surgery
ISSN: 1445-2197
Titre abrégé: ANZ J Surg
Pays: Australia
ID NLM: 101086634
Informations de publication
Date de publication:
05 2020
05 2020
Historique:
received:
17
01
2020
revised:
09
03
2020
accepted:
19
03
2020
pubmed:
30
4
2020
medline:
15
5
2021
entrez:
30
4
2020
Statut:
ppublish
Résumé
The American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) surgical risk calculator provides an estimate preoperatively of operative risks including mortality; however, its utility is not known in Australian emergency general surgical patients. This study sought to determine accuracy of the calculator in predicting outcome of high-risk patients in an Australian acute surgical unit to establish if this calculator could be a useful tool to identify high-risk patients in an Australian setting. Retrospective analysis of patients admitted to the acute surgical unit at a tertiary referral centre between 2018 and 2019 was conducted. High-risk patients were defined as those who underwent an emergency operation with an ACS-NSQIP surgical mortality score ≥5%. Post-operative outcomes assessed included mortality and return to operating theatre, readmission and discharge to nursing home. External validation of the calculator was performed using discrimination and calibration statistics. Over a 14-month period, 58 patients were high risk, with an average age of 75 years, 93% were classified as functionally independent/partially dependent and 91.4% underwent a laparotomy. Overall 30-day mortality rate was 20.7%. The ACS-NSQIP calculator was a reliable predictor of mortality, with c-statistic of 0.835 (0.654-0.977), Brier score of 0.125 (0.081-0.176) and Hosmer-Lemeshow statistic of 0.389. The calculator was less accurate in its prediction of other outcomes assessed. The ACS-NSQIP calculator accurately approximated mortality in high-risk Australian patients requiring emergency surgery. This study has demonstrated that in this patient population, the calculator could reliably be applied in the multidisciplinary care of emergency surgical patients.
Sections du résumé
BACKGROUND
The American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) surgical risk calculator provides an estimate preoperatively of operative risks including mortality; however, its utility is not known in Australian emergency general surgical patients. This study sought to determine accuracy of the calculator in predicting outcome of high-risk patients in an Australian acute surgical unit to establish if this calculator could be a useful tool to identify high-risk patients in an Australian setting.
METHODS
Retrospective analysis of patients admitted to the acute surgical unit at a tertiary referral centre between 2018 and 2019 was conducted. High-risk patients were defined as those who underwent an emergency operation with an ACS-NSQIP surgical mortality score ≥5%. Post-operative outcomes assessed included mortality and return to operating theatre, readmission and discharge to nursing home. External validation of the calculator was performed using discrimination and calibration statistics.
RESULTS
Over a 14-month period, 58 patients were high risk, with an average age of 75 years, 93% were classified as functionally independent/partially dependent and 91.4% underwent a laparotomy. Overall 30-day mortality rate was 20.7%. The ACS-NSQIP calculator was a reliable predictor of mortality, with c-statistic of 0.835 (0.654-0.977), Brier score of 0.125 (0.081-0.176) and Hosmer-Lemeshow statistic of 0.389. The calculator was less accurate in its prediction of other outcomes assessed.
CONCLUSION
The ACS-NSQIP calculator accurately approximated mortality in high-risk Australian patients requiring emergency surgery. This study has demonstrated that in this patient population, the calculator could reliably be applied in the multidisciplinary care of emergency surgical patients.
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
746-751Informations de copyright
© 2020 Royal Australasian College of Surgeons.
Références
Watt DG, Wilson MSJ, Shapter OC, Patil P. 30-Day and 1-year mortality in emergency general surgery laparotomies: an area of concern and need for improvement? Eur. J. Trauma Emerg. Surg. 2015; 41: 369-74.
Boyd W, Jackson N. Clinical review: how is risk defined in high-risk surgical patient management? Crit. Care 2005; 9: 390-6.
Bilimoria KY, Liu Y, Paruch JL et al. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J. Am. Coll. Surg. 2013; 217: 833-42.e3.
Keller DS, Ho JW, Mercadel AJ, Ogola GO, Steele SR. Are we taking a risk with risk assessment tools? Evaluating the relationship between NSQIP and the ACS risk calculator in colorectal surgery. Am. J. Surg. 2018; 216: 645-51.
Collard MK, Moszkowicz D, Clause-Verdreau AC et al. Postoperative morbidity and mortality for malignant colon obstruction: the American College of Surgeon calculator reliability. J. Surg. Res. 2018; 226: 112-21.
Fruscione M, Kirks R, Cochran A et al. Developing and validating a center-specific preoperative prediction calculator for risk of outcomes following major hepatectomy procedures. HPB 2018; 20: 721-8.
Basta MN, Bauder AR, Kovach SJ, Fischer JP. Assessing the predictive accuracy of the American College of Surgeons National Surgical Quality Improvement Project Surgical Risk Calculator in open ventral hernia repair. Am. J. Surg. 2016; 212: 272-81.
Hunter Emergency Laparotomy Collaborator Group. High-risk emergency laparotomy in Australia: comparing NELA, P-Possum and ACS-NSQIP calculators. J. Surg. Res. 2019; 246: 300-4.
American College of Surgeons. ACS NSQIP Surgical Risk Calculator - enter patient and surgical information. 2019. [Cited Sep 2019.] Available from URL: https://riskcalculator.facs.org/RiskCalculator/PatientInfo.jsp
Kraemer K, Cohen M, Liu Y et al. Development and evaluation of the American College of Surgeons NSQIP pediatric surgical risk calculator. J. Am. Coll. Surg. 2016; 223: 685-93.
Kramer A, Zimmerman J. Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit. Care Med. 2007; 35: 2052-6.
R Core Team. R: a language and environment for statistical computing. 2019. [Cited Sep 2019.] Available from URL: https://www.R-project.org/
Burgess JR, Smith B, Britt R, Weireter L, Polk T. Predicting postoperative complications for acute care surgery patients using the ACS NSQIP surgical risk calculator. Am. Surg. 2017; 83: 733-8.
Protopapa K, Simpson J, Smith N, Moonesinghe S. Development and validation of the Surgical Outcome Risk Tool (SORT). Br. J. Surg. 2014; 101: 1774-83.
Le Manach Y, Collins G, Rosdeth R et al. Preoperative score to predict postoperative mortality (POSPOM): derivation and validation. Anesthesiology 2016; 124: 570-9.
Campbell D, Boyle L, Soakell-Ho M et al. National risk prediction model for perioperative mortality in non-cardiac surgery. Br. J. Surg. 2019; 106: 1549-57.
Paul E, Bailey M, Van Lint A, Pilcher D. Performance of APACHE III over time in Australia and New Zealand: a retrospective cohort study. Anaesth. Intensive Care 2012; 40: 980-94.
Cohen M, Liu Y, Ko K, Hall B. An examination of American College of Surgeons NSQIP surgical risk calculator accuracy. J. Am. Coll. Surg. 2017; 224: 787-95.