Performance Assessment of the American College of Surgeons Risk Calculator in Metastatic Spinal Tumor Surgery.
Journal
Spine
ISSN: 1528-1159
Titre abrégé: Spine (Phila Pa 1976)
Pays: United States
ID NLM: 7610646
Informations de publication
Date de publication:
15 Jun 2023
15 Jun 2023
Historique:
received:
27
10
2022
accepted:
04
02
2023
medline:
5
6
2023
pubmed:
28
3
2023
entrez:
27
3
2023
Statut:
ppublish
Résumé
This was a retrospective cohort study. The objective of this study was to assess the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) surgical risk calculator performance in patients undergoing surgery for metastatic spine disease. Patients with spinal metastases may require surgical intervention for cord compression or mechanical instability. The ACS-NSQIP calculator was developed to assist surgeons with estimating 30-day postoperative complications based on patient-specific risk factors and has been validated within several surgical patient populations. We included 148 consecutive patients at our institution who underwent surgery for metastatic spine disease between 2012 and 2022. Our outcomes were 30-day mortality, 30-day major complications, and length of hospital stay (LOS). Predicted risk, determined by the calculator, was compared with observed outcomes using receiver operating characteristic curves with area under the curve (AUC) and Wilcoxon signed-rank tests. Analyses were repeated using individual corpectomy and laminectomy Current Procedural Terminology (CPT) codes to determine procedure-specific accuracy. Based on the ACS-NSQIP calculator, there was good discrimination between observed and predicted 30-day mortality incidence overall (AUC=0.749), as well as in corpectomy cases (AUC=0.745) and laminectomy cases (AUC=0.788). Poor 30-day major complication discrimination was seen in all procedural cohorts, including overall (AUC=0.570), corpectomy (AUC=0.555), and laminectomy (AUC=0.623). The overall median observed LOS was similar to predicted LOS (9 vs. 8.5 d, P =0.125). Observed and predicted LOS were also similar in corpectomy cases (8 vs. 9 d; P =0.937) but not in laminectomy cases (10 vs. 7 d, P =0.012). The ACS-NSQIP risk calculator was found to accurately predict 30-day postoperative mortality but not 30-day major complications. The calculator was also accurate in predicting LOS following corpectomy but not laminectomy. While this tool may be utilized to predict risk short-term mortality in this population, its clinical value for other outcomes is limited.
Sections du résumé
STUDY DESIGN
METHODS
This was a retrospective cohort study.
OBJECTIVE
OBJECTIVE
The objective of this study was to assess the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) surgical risk calculator performance in patients undergoing surgery for metastatic spine disease.
SUMMARY OF BACKGROUND DATA
BACKGROUND
Patients with spinal metastases may require surgical intervention for cord compression or mechanical instability. The ACS-NSQIP calculator was developed to assist surgeons with estimating 30-day postoperative complications based on patient-specific risk factors and has been validated within several surgical patient populations.
MATERIALS AND METHODS
METHODS
We included 148 consecutive patients at our institution who underwent surgery for metastatic spine disease between 2012 and 2022. Our outcomes were 30-day mortality, 30-day major complications, and length of hospital stay (LOS). Predicted risk, determined by the calculator, was compared with observed outcomes using receiver operating characteristic curves with area under the curve (AUC) and Wilcoxon signed-rank tests. Analyses were repeated using individual corpectomy and laminectomy Current Procedural Terminology (CPT) codes to determine procedure-specific accuracy.
RESULTS
RESULTS
Based on the ACS-NSQIP calculator, there was good discrimination between observed and predicted 30-day mortality incidence overall (AUC=0.749), as well as in corpectomy cases (AUC=0.745) and laminectomy cases (AUC=0.788). Poor 30-day major complication discrimination was seen in all procedural cohorts, including overall (AUC=0.570), corpectomy (AUC=0.555), and laminectomy (AUC=0.623). The overall median observed LOS was similar to predicted LOS (9 vs. 8.5 d, P =0.125). Observed and predicted LOS were also similar in corpectomy cases (8 vs. 9 d; P =0.937) but not in laminectomy cases (10 vs. 7 d, P =0.012).
CONCLUSIONS
CONCLUSIONS
The ACS-NSQIP risk calculator was found to accurately predict 30-day postoperative mortality but not 30-day major complications. The calculator was also accurate in predicting LOS following corpectomy but not laminectomy. While this tool may be utilized to predict risk short-term mortality in this population, its clinical value for other outcomes is limited.
Identifiants
pubmed: 36972073
doi: 10.1097/BRS.0000000000004644
pii: 00007632-202306150-00002
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
825-831Informations de copyright
Copyright © 2023 Wolters Kluwer Health, Inc. All rights reserved.
Déclaration de conflit d'intérêts
The authors report no conflicts of interest.
Références
Perrin RG, Laxton AW. Metastatic spine disease: epidemiology, pathophysiology, and evaluation of patients. Neurosurg Clin N Am. 2004;15:365–373.
Ober WB. Tumors and tumorous conditions of the bones and joints. Yale J Biol Med. 1959;4:252–253.
Patchell RA, Tibbs PA, Regine WF, et al. Direct decompressive surgical resection in the treatment of spinal cord compression caused by metastatic cancer: a randomised trial. Lancet. 2005;366:643–648.
Nasser R, Yadla S, Maltenfort MG, et al. Complications in spine surgery. J Neurosurg Spine. 2010;13:144–157.
Zhu X, Lu J, Xu H, et al. A comparative study between minimally invasive spine surgery and traditional open surgery for patients with spinal metastasis. Spine (Phila Pa 1976). 2021;46:62–68.
Li G, Patil CG, Lad SP, Ho C, Tian W, Boakye M. Effects of age and comorbidities on complication rates and adverse outcomes after lumbar laminectomy in elderly patients. Spine (Phila Pa 1976). 2008;33:1250–1255.
Deyo RA. Trends, major medical complications, and charges associated with surgery for lumbar spinal stenosis in older adults. JAMA. 2010;303:1259.
Luksanapruksa P, Buchowski JM, Zebala LP, Kepler CK, Singhatanadgige W, Bumpass DB. Perioperative complications of spinal metastases surgery. Clin Spine Surg. 2017;30:4–13.
Ethun CG, Bilen MA, Jani AB, Maithel SK, Ogan K, Master VA. Frailty and cancer: implications for oncology surgery, medical oncology, and radiation oncology. CA Cancer J Clin. 2017;67:362–377.
Ahmed AK, Goodwin CR, Heravi A, et al. Predicting survival for metastatic spine disease: a comparison of nine scoring systems. Spine J. 2018;18:1804–1814.
Bilimoria KY, Liu Y, Paruch JL, et al. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg. 2013;217:833–842.e1–3.
Mitka M. Data-based risk calculators becoming more sophisticated—and more popular. JAMA. 2009;302:730–731.
Liu JY, Sharma J. Application of the ACS NSQIP surgical risk calculator on a global scale. Am J Surg. 2021;222:876.
Prasad KG, Nelson BG, Deig CR, Schneider AL, Moore MG. ACS NSQIP risk calculator: an accurate predictor of complications in major head and neck surgery. Otolaryngol Head Neck Surg. 2016;155:740–742.
Walker JB, Gogoj A, Saunders BD, Canter DJ, Lehman K, Raman JD. Accuracy of the NSQIP risk calculator for predicting complications following adrenalectomy. Int Urol Nephrol. 2019;51:1291–1295.
Parkin CJ, Moritz P, Kirkland O, Glover A. What is the accuracy of the ACS-NSQIP surgical risk calculator in emergency abdominal surgery? A meta-analysis. J Surg Res. 2021;268:300–307.
Cohen ME, Liu Y, Ko CY, Hall BL. An examination of American College of Surgeons NSQIP surgical risk calculator accuracy. J Am Coll Surg. 2017;224:787–795.e1.
McCarthy MH, Singh P, Nayak R, et al. Can the American College of Surgeons risk calculator predict 30-day complications after spine surgery? Spine (Phila Pa 1976). 2020;45:621–628.
Narain AS, Kitto AZ, Braun B, et al. Does the ACS NSQIP surgical risk calculator accurately predict complications rates after anterior lumbar interbody fusion procedures. Spine (Phila Pa 1976). 2021;46:E655–E662.
Wang X, Hu Y, Zhao B, Su Y. Predictive validity of the ACS-NSQIP surgical risk calculator in geriatric patients undergoing lumbar surgery. Medicine (Baltimore). 2017;96:e8416.
McCarthy MH, Singh P, Maslak J, et al. Can the American College of Surgeons risk calculator predict 30-day complications after cervical spine surgery. Clin Spine Surg. 2019;32:357–362.
Alzahrani SM, Ko CS, Yoo MW. Validation of the ACS NSQIP surgical risk calculator for patients with early gastric cancer treated with laparoscopic gastrectomy. J Gastric Cancer. 2020;20:267–276.
van der Hulst HC, Dekker JWT, Bastiaannet E, et al. Validation of the ACS NSQIP surgical risk calculator in older patients with colorectal cancer undergoing elective surgery. J Geriatr Oncol. 2022;13:788–795.
Manning-Geist B, Cathcart AM, Sullivan MW, et al. Predictive validity of American College of Surgeons: National Surgical Quality Improvement Project risk calculator in patients with ovarian cancer undergoing interval debulking surgery. Int J Gynecol Cancer. 2021;31:1356–1362.
Mandrekar JN. Receiver operating characteristic curve in diagnostic test assessment. J Thorac Oncol. 2010;5:1315–1316.
Igoumenou VG, Mavrogenis AF, Angelini A, et al. Complications of spine surgery for metastasis. Eur J Orthop Surg Traumatol. 2020;30:37–56.
Paruch JL, Ko CY, Bilimoria KY. An opportunity to improve informed consent and shared decision making: the role of the ACS NSQIP surgical risk calculator in oncology. Ann Surg Oncol. 2014;21:5–7.
Cohen ME, Bilimoria KY, Ko CY, Hall BL. Development of an American College of Surgeons National Surgery Quality Improvement Program: morbidity and mortality risk calculator for colorectal surgery. J Am Coll Surg. 2009;208:1009–1016.
Dave A, Beal EW, Lopez-Aguiar AG, et al. Evaluating the ACS NSQIP risk calculator in primary pancreatic neuroendocrine tumor: results from the US Neuroendocrine Tumor Study Group. J Gastrointest Surg. 2019;23:2225–2231.
Vos EL, Russo AE, Hohmann A, et al. Performance of the American College of Surgeons NSQIP surgical risk calculator for total gastrectomy. J Am Coll Surg. 2020;231:650–656.
Houdek MT, Hevesi M, Griffin AM, et al. Can the ACS-NSQIP surgical risk calculator predict postoperative complications in patients undergoing sacral tumor resection for chordoma? J Surg Oncol. 2020;121:1036–1041.
Labott JR, Brinkmann EJ, Hevesi M, Couch CG, Rose PS, Houdek MT. The ACS-NSQIP surgical risk calculator is a poor predictor of postoperative complications in patients undergoing oncologic distal femoral replacement. Knee. 2021;33:17–23.
Paulino Pereira NR, Ogink PT, Groot OQ, et al. Complications and reoperations after surgery for 647 patients with spine metastatic disease. Spine J. 2019;19:144–156.
Lau D, Leach MR, Than KD, Ziewacz J, La Marca F, Park P. Independent predictors of complication following surgery for spinal metastasis. Eur Spine J. 2013;22:1402–1407.
Wise JJ, Fischgrund JS, Herkowitz HN, Montgomery D, Kurz LT. Complication, survival rates, and risk factors of surgery for metastatic disease of the spine. Spine (Phila Pa 1976). 1999;24:1943–1951.
Dea N, Versteeg A, Fisher C, et al. Adverse events in emergency oncological spine surgery: a prospective analysis. J Neurosurg Spine. 2014;21:698–703.
Anzuatégui PR, Cunha L, Mello GJP, Stieven Filho E, Graells XS. Spinal metastasis surgery: a proposal for a predictive model of morbidity and mortality. Rev Bras Ortop (Sao Paulo). 2019;54:665–672.
Karhade AV, Thio Q, Ogink PT, et al. Development of machine learning algorithms for prediction of 30-day mortality after surgery for spinal metastasis. Neurosurgery. 2019;85:E83–E91.
Arrigo RT, Kalanithi P, Cheng I, et al. Predictors of survival after surgical treatment of spinal metastasis. Neurosurgery. 2011;68:674–681; discussion 681.
Moon KY, Chung CK, Jahng TA, Kim HJ, Kim CH. Postoperative survival and ambulatory outcome in metastatic spinal tumors: prognostic factor analysis. J Korean Neurosurg Soc. 2011;50:216–223.
Cahill KS, Chi JH, Day AL, Claus EB. Trends in survival after surgery for breast cancer metastatic to the brain and spinal column in medicare patients: a population-based analysis. Neurosurgery. 2011;68:705–713; discussion 713.
Pointillart V, Vital JM, Salmi R, Diallo A, Quan GM. Survival prognostic factors and clinical outcomes in patients with spinal metastases. J Cancer Res Clin Oncol. 2011;137:849–856.
Tabouret E, Cauvin C, Fuentes S, et al. Reassessment of scoring systems and prognostic factors for metastatic spinal cord compression. Spine J. 2015;15:944–950.
Ratasvuori M, Wedin R, Hansen BH, et al. Prognostic role of en-bloc resection and late onset of bone metastasis in patients with bone-seeking carcinomas of the kidney, breast, lung, and prostate: SSG study on 672 operated skeletal metastases. J Surg Oncol. 2014;110:360–365.
Hosono N, Ueda T, Tamura D, Aoki Y, Yoshikawa H. Prognostic relevance of clinical symptoms in patients with spinal metastases. Clin Orthop Relat Res. 2005;436:196–201.
Park JH, Rhim SC, Jeon SR. Efficacy of decompression and fixation for metastatic spinal cord compression: analysis of factors prognostic for survival and postoperative ambulation. J Korean Neurosurg Soc. 2011;50:434–440.
Chong S, Shin SH, Yoo H, et al. Single-stage posterior decompression and stabilization for metastasis of the thoracic spine: prognostic factors for functional outcome and patients’ survival. Spine J. 2012;12:1083–1092.
Tatsui CE, Suki D, Rao G, et al. Factors affecting survival in 267 consecutive patients undergoing surgery for spinal metastasis from renal cell carcinoma. J Neurosurg Spine. 2014;20:108–116.
Luksanapruksa P, Buchowski JM, Hotchkiss W, Tongsai S, Wilartratsami S, Chotivichit A. Prognostic factors in patients with spinal metastasis: a systematic review and meta-analysis. Spine J. 2017;17:689–708.
Houten JK, Weinstein GR, Collins MJ, Komlos D. Bilateral paraspinal muscle flap closure technique for reduction of wound complications from posterior thoracolumbar spinal fusion: results of a series of 716 patients. J Neurosurg Spine. 2020:1–7. doi:10.3171/2020.6.SPINE20755
doi: 10.3171/2020.6.SPINE20755
Mohd Rothi I, Deverall HH, Baker JF. The modified Frailty Index does not correlate with survival in surgically-treated patients with metastatic spine disease. J Clin Neurosci. 2019;66:178–181.
Elsamadicy AA, Havlik JL, Reeves B, et al. Assessment of frailty indices and Charlson Comorbidity Index for predicting adverse outcomes in patients undergoing surgery for spine metastases: a national database analysis. World Neurosurg. 2022;164:e1058–e1070.
Hersh AM, Pennington Z, Hung B, et al. Comparison of frailty metrics and the Charlson Comorbidity Index for predicting adverse outcomes in patients undergoing surgery for spine metastases. J Neurosurg Spine. 2021:1–9. doi:10.3171/2021.8.SPINE21559
doi: 10.3171/2021.8.SPINE21559
Atkinson RA, Davies B, Jones A, van Popta D, Ousey K, Stephenson J. Survival of patients undergoing surgery for metastatic spinal tumours and the impact of surgical site infection. J Hosp Infect. 2016;94:80–85.
Schoenfeld AJ, Le HV, Marjoua Y, et al. Assessing the utility of a clinical prediction score regarding 30-day morbidity and mortality following metastatic spinal surgery: the New England Spinal Metastasis Score (NESMS). Spine J. 2016;16:482–490.
De la Garza Ramos R, Goodwin CR, Jain A, et al. Development of a Metastatic Spinal Tumor Frailty Index (MSTFI) using a nationwide database and its association with inpatient morbidity, mortality, and length of stay after spine surgery. World Neurosurg. 2016;95:548–555.e4.
De la Garza Ramos R, Naidu I, Choi JH, et al. Comparison of three predictive scoring systems for morbidity in oncological spine surgery. J Clin Neurosci. 2021;94:13–17.