Measurement that matters: A systematic review and modified Delphi of multidisciplinary colorectal cancer quality indicators.
Delphi
colorectal neoplasms
quality indicators
quality of care
systematic review
Journal
Asia-Pacific journal of clinical oncology
ISSN: 1743-7563
Titre abrégé: Asia Pac J Clin Oncol
Pays: Australia
ID NLM: 101241430
Informations de publication
Date de publication:
01 Feb 2023
01 Feb 2023
Historique:
revised:
19
12
2022
received:
19
09
2022
accepted:
26
12
2022
entrez:
2
2
2023
pubmed:
3
2
2023
medline:
3
2
2023
Statut:
aheadofprint
Résumé
To develop a priority set of quality indicators (QIs) for use by colorectal cancer (CRC) multidisciplinary teams (MDTs). The review search strategy was executed in four databases from 2009-August 2019. Two reviewers screened abstracts/manuscripts. Candidate QIs and characteristics were extracted using a tailored abstraction tool and assessed for scientific soundness. To prioritize candidate indicators, a modified Delphi consensus process was conducted. Consensus was sought over two rounds; (1) multidisciplinary expert workshops to identify relevance to Australian CRC MDTs, and (2) an online survey to prioritize QIs by clinical importance. A total of 93 unique QIs were extracted from 118 studies and categorized into domains of care within the CRC patient pathway. Approximately half the QIs involved more than one discipline (52.7%). One-third of QIs related to surgery of primary CRC (31.2%). QIs on supportive care (6%) and neoadjuvant therapy (6%) were limited. In the Delphi Round 1, workshop participants (n = 12) assessed 93 QIs and produced consensus on retaining 49 QIs including six new QIs. In Round 2, survey participants (n = 44) rated QIs and prioritized a final 26 QIs across all domains of care and disciplines with a concordance level > 80%. Participants represented all MDT disciplines, predominantly surgical (32%), radiation (23%) and medical (20%) oncology, and nursing (18%), across six Australian states, with an even spread of experience level. This study identified a large number of existing CRC QIs and prioritized the most clinically relevant QIs for use by Australian MDTs to measure and monitor their performance.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Subventions
Organisme : Radiation Oncology Network, Western Sydney Local Health District
Organisme : Sydney West Translational Cancer Research Centre, The Cancer Institute NSW, Translational Cancer Research Centres
ID : 15/TRC/1-01
Informations de copyright
© 2023 The Authors. Asia-Pacific Journal of Clinical Oncology published by John Wiley & Sons Australia, Ltd.
Références
Cancer Australia. National cancer control indicators. Available from: https://ncci.canceraustralia.gov.au/cancer-types/colorectal-cancer
Australian Institute of Health and Welfare. Cancer data in Australia Canberra: AIHW. 2021. Available from: https://www.aihw.gov.au/reports/cancer/cancer-data-in-australia
Cancer Council Australia. Clinical Practice Guidelines for the Prevention, Early Detection and Management of Colorectal Cancer. Cancer Council Australia; 2017.
Australi Cancer, a. All about multidisciplinary care Available from: https://www.canceraustralia.gov.au/clinical-best-practice/multidisciplinary-care/all-about-multidisciplinary-care
National Institute for Health and Care Excellence. Colorectal Cancer: NICE Guideline United Kingdom: NICE; 2020. Available from: www.nice.org.uk/guidance/ng151
Selby P, Popescu R, Lawler M, Butcher H, Costa A. The value and future developments of multidisciplinary team cancer care. Am Soc Clin Oncol Educ Book. 2019;39:332-340.
Lan Y-T, Lin J-K, Jiang J-K. Effects of a multidisciplinary team on colorectal cancer treatment. Formos J Surg. 2015;48(5):145-150.
Specchia ML, Frisicale EM, Carini E, et al. The impact of tumor board on cancer care: evidence from an umbrella review. BMC Health Serv Res. 2020;20(1):73.
Pai S, Blaisdell D, Brodie R, et al. Defining current gaps in quality measures for cancer immunotherapy: consensus report from the Society for Immunotherapy of Cancer (SITC) 2019 Quality Summit. J Immunother Cancer. 2020;8(1):e000112.
Menon M, Cunningham C, Kerr D. Addressing unwarranted variations in colorectal cancer outcomes: a conceptual approach. Nat Rev Clin Oncol. 2016;13(11):706-712.
Mainz J. Quality indicators: essential for quality improvement. Int J Qual Health Care. 2004;16:i1-i2.
Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260(12):1743-1748.
Donabedian A. Evaluating the quality of medical care. Milbank Q. 1966;44(3):166-206.
Cancer Institute NSW. Cancer Control in NSW: Statewide Report 2019. Cancer Institute NSW; 2020.
Chazapis M, Gilhooly D, Smith A, et al. Perioperative structure and process quality and safety indicators: a systematic review. Br J Anaesth. 2018;120(1):51-66.
Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003;15(6):523-530.
Wollersheim H, Hermens R, Hulscher M, et al. Clinical indicators: development and applications. Neth J Med. 2007;65(1):15-22.
Albert JM, Das P. Quality assessment in oncology. Int J Radiat Oncol Biol Phys. 2012;83(3):773-781.
Meyer GS, Nelson EC, Pryor DB, et al. More quality measures versus measuring what matters: a call for balance and parsimony. BMJ Qual Saf. 2012;21(11):964.
Copnell B, Hagger V, Wilson SG, Evans SM, Sprivulis PC, Cameron PA. Measuring the quality of hospital care: an inventory of indicators. Int Med J. 2009;39(6):352-360.
Schardt C, Adams MB, Owens T, Keitz S, Fontelo P. Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Med Inform Decis Mak. 2007;7(1):1-6.
van den Bosch CM, Hulscher ME, Natsch S, Gyssens IC, Prins JM, Geerlings SE. Development of quality indicators for antimicrobial treatment in adults with sepsis. BMC Infect Dis. 2014;14(1):345.
CBO: Kwaliteitsinstituut voor de Gezondheidszorg CBO hvwhwcnte-b-w-r-pr.
Chiew K, Jalaludin B, Sundaresan P, Vinod S. P3. 15-07 a literature review and assessment of lung cancer quality indicators. J Thorac Oncol. 2018;13(10):S993.
Keikes L, Koopman M, Tanis PJ, Lemmens V, Punt CJA, van Oijen MGH. Evaluating the scientific basis of quality indicators in colorectal cancer care: a systematic review. Eur J Cancer. 2017;86:166-177.
Bianchi V, Spitale A, Ortelli L, Mazzucchelli L, Bordoni A. Quality indicators of clinical cancer care (QC3) in colorectal cancer. BMJ Open. 2013;3(7):e002818.
Jones J, Hunter D. Consensus methods for medical and health services research. BMJ. 1995;311(7001):376-380.
Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008-1015.
Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS One. 2011;6(6):e20476.
De Villiers MR, De Villiers PJ, Kent AP. The Delphi technique in health sciences education research. Med Teach. 2005;27(7):639-643.
Ives J, Dunn M, Molewijk B, et al. Standards of practice in empirical bioethics research: towards a consensus. BMC Med Ethics. 2018;19(1):1-20.
Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)-a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377-381.
Moher D, Liberati A, Tetzlaff J, Altman D. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.
NHS Scotland. Colorectal cancer - clinical quality performance indicators. In: Scottish Cancer Taskforce. v3.0 ed. Healthcare Improvement Scotland; 2017; 1-33.
Desch C, McNiff K, Schneider E, et al. American Society of Clinical Oncology/National Comprehensive Cancer Network quality measures. J Clin Oncol. 2008;26(21):3631-3637.
Malin J, Schneider E, Epstein A, Adams J, Emanuel EJ, Kahn KL. Results of the National Initiative for Cancer Care Quality: how can we improve the quality of cancer care in the United States? J Clin Oncol. 2006;24(4):626-634.
Van Leersum N, Snijders H, Henneman D, et al. The dutch surgical colorectal audit. Eur J Surg Oncol. 2013;39(10):1063-1070.
Dagher H, Ahern S, Salimi F, et al. The bi-national colorectal cancer audit report 2019. Colorectal Surgical Society of Australia and New Zealand; 2019.
Commission on Cancer. The National Accreditation Program for Rectal Cancer Standards Manual. American College of Surgeons; 2017.
Walpole E, Theile D, Philpot S, Youl P. Development and implementation of a cancer quality index in Queensland, Australia: a tool for monitoring cancer care. J Oncol Pract. 2019;15(7):636-643.
Dixon E, Armstrong C, Maddern G, et al. Development of quality indicators of care for patients undergoing hepatic resection for metastatic colorectal cancer using a Delphi process. J Surg Res. 2009;156(1):32-38.
van der Geest LG, Krijnen P, Wouters MW, et al. Improved guideline compliance after a 3-year audit of multidisciplinary colorectal cancer care in the western part of the Netherlands. J Surg Oncol. 2012;106(1):1-9.
McConnell Y, Inglis K, Porter G. Timely access and quality of care in colorectal cancer: are they related? Int J Qual Health Care. 2010;22(3):219-228.
Porter G, Urquhart R, Kendell C, Bu J, McConnell Y, Grunfeld E. Timely access and quality of care in colorectal cancer: a population-based cohort study using administrative data. BMC Res Notes. 2013;6:355.
Gooiker GA, Kolfschoten NE, Bastiaannet E, et al. Evaluating the validity of quality indicators for colorectal cancer care. J Surg Oncol. 2013;108(7):465-471.
Kolfschoten NE, Gooiker GA, Bastiaannet E, et al. Combining process indicators to evaluate quality of care for surgical patients with colorectal cancer: are scores consistent with short-term outcome? BMJ Qual Saf. 2012;21(6):481-489.
Spitale A, Ortelli L, Mazzucchelli L, Bordoni A. Quality indicators of colorectal cancer care in southern Switzerland: results from a population-based study. Swiss Med Wkly. 2017;147(4748).
Ludt S, Urban E, Eckardt J, et al. Evaluating the quality of colorectal cancer care across the interface of healthcare sectors. PLoS One. 2013;8(5):e60947.
Malafa MP, Corman MM, Shibata D, Siegel EM, Lee JH, Jacobsen PB. The Florida initiative for quality cancer care: a regional project to measure and improve cancer care. Cancer Control. 2009;16(4):318-327.
Jackson GL, Zullig LL, Zafar SY, et al. Using NCCN clinical practice guidelines in oncology to measure the quality of colorectal cancer care in the veterans health administration. J Natl Compr Canc Netw. 2013;11(4):431-441.
Jannasch O, Udelnow A, Romano G, et al. International quality assurance project in colorectal cancer-unifying diagnostic and histopathological evaluation. Langenbecks Arch Surg. 2014;399(4):473-479.
Mathoulin-Pelissier S, Becouarn Y, Belleannee G, et al. Quality indicators for colorectal cancer surgery and care according to patient-, tumor-, and hospital-related factors. BMC Cancer. 2012;12:297.
Camps C, Albanell J, Anton A, et al. Quality indicators to assure and improve cancer care in Spain using the Delphi technique. J Natl Compr Canc Netw. 2016;14(5):553-558.
Chung K, Chen L, Chang Y, Chang Y, Lai M. Application of the analytic hierarchy process in the performance measurement of colorectal cancer care for the design of a pay-for-performance program in Taiwan. Int J Qual Health Care. 2013;25(1):81-91.
Demetter P, Ceelen W, Danse E, et al. Quality of care indicators in rectal cancer. Acta Gastroenterol Belg. 2011;74(3):445-450.
Khare SR, Batist G, Bartlett G. Identification of performance indicators across a network of clinical cancer programs. Oncol. 2016;23(2):81-90.
Brady J, Xu Z, Scarberry K, et al. Evaluating the current status of rectal cancer care in the US: where we stand at the start of the Commission on Cancer's National Accreditation Program for Rectal Cancer. J Am Coll Surg. 2018;226(5):881-890.
Hayman A, Chang E, Molokie R, Kahng L, Prystowsky JB, Bentrem DJ. Assessing compliance with national quality measures to improve colorectal cancer care at the VA. Am J Surg. 2010;200(5):572-576.
Helewa RM, Turner D, Wirtzfeld D, et al. Does geography influence the treatment and outcomes of colorectal cancer? A population-based analysis. World J Surg Oncol. 2013;11:140.
Stelzner S, Hellmich G, Haroske G, Puffer E, Jackisch T, Witzigmann H. Practicability of quality goals for the treatment of rectal cancer. Int J Colorectal Dis. 2010;25(9):1093-1102.
Young JM, Masya LM, Solomon MJ, Shepherd HL. Identifying indicators of colorectal cancer care coordination: a Delphi study. Colorectal Dis. 2014;16(1):17-25.
Leal TB, Holden T, Cavalcante L, et al. Colon cancer staging in vulnerable older adults: adherence to national guidelines and impact on survival. Ann Hematol Oncol. 2014;1(3).
Corbellini C, Andreoni B, Ansaloni L, et al. Reliability and validity assessment of administrative databases in measuring the quality of rectal cancer management. Tumori. 2018;104(1):51-59.
Siegel EM, Jacobsen PB, Lee JH, et al. Florida initiative for quality cancer care: improvements on colorectal cancer quality of care indicators during a 3-year interval. J Am Coll Surg. 2014;218(1):16-25.
Siegel EM, Jacobsen PB, Malafa M, et al. Evaluating the quality of colorectal cancer care in the state of Florida: results from the Florida initiative for quality cancer care. J Oncol Pract. 2012;8(4):239-245.
Vergara-Fernandez O, Swallow CJ, Victor JC, et al. Assessing outcomes following surgery for colorectal cancer using quality of care indicators. Can J Surg. 2010;53(4):232-240.
Ruffo G, Barugola G, Rossini R, Sartori CA. Colorectal surgery in Italy. Criteria to identify the hospital units and the tertiary referral centers entitled to perform it. Updates Surg. 2016;68(2):123-128.
Krzyzanowska MK, Barbera L, Elit L, et al. Identifying population-level indicators to measure the quality of cancer care for women. Int J Qual Health Care. 2011;23(5):554-564.
Habib MR, Solomon MJ, Young JM, Armstrong BK, O'Connell D, Armstrong K. Evidence-based and clinical outcome scores to facilitate audit and feedback for colorectal cancer care. Dis Colon Rectum. 2009;52(4):616-623.
Merkel S, Klossek D, Gohl J, Papadopoulos T, Hohenberger W, Hermanek P. Quality management in rectal carcinoma: what is feasible? Int J Colorectal Dis. 2009;24(8):931-942.
McColl RJ, McGahan CE, Cai E, et al. Impact of hospital volume on quality indicators for rectal cancer surgery in British Columbia, Canada. Am J Surg. 2017;213(2):388-394.
Raoof M, Zafar SN, Ituarte PHG, Krouse RS, Melstrom K. Using a lymph node count metric to identify underperforming hospitals after rectal cancer surgery. J Surg Res. 2019;236:216-223.
Samuel CA, Zaslavsky AM, Landrum MB, Lorenz K, Keating NL. Developing and evaluating composite measures of cancer care quality. Med Care. 2015;53(1):54-64.
Schneider PM, Vallbohmer D, Ploenes Y, et al. Evaluation of quality indicators following implementation of total mesorectal excision in primarily resected rectal cancer changed future management. Int J Colorectal Dis. 2011;26(7):903-909.
Spain P, Teixeira-Poit S, Halpern MT, et al. The National Cancer Institute Community Cancer Centers Program (NCCCP): sustaining quality and reducing disparities in guideline-concordant breast and colon cancer care. Oncologist. 2017;22(8):910-917.
Yu S, Shabihkhani M, Yang D, et al. Timeliness of adjuvant chemotherapy for stage III adenocarcinoma of the aolon: a measure of quality of care. Clin Colorectal Cancer. 2013;12(4):275-279.
Mason MC, Chang GJ, Petersen LA, et al. National Quality Forum colon cancer quality metric performance: how are hospitals measuring up? Ann Surg. 2017;266(6):1013-1020.
Massarweh NN, Haynes AB, Chiang YJ, et al. Adequacy of the national quality forum's colon cancer adjuvant chemotherapy quality metric: is 4 months soon enough? Ann Surg. 2015;262(2):312-320.
Soria-Aledo V, Angel-Garcia D, Martinez-Nicolas I, Rebasa Cladera P, Cabezali Sanchez R, Pereira Garcia LF. Development and pilot study of an essential set of indicators for general surgery services. Cir Esp. 2016;94(9):502-510.
Comber H, Sharp L, Timmons A, Keane FB. Quality of rectal cancer surgery and its relationship to surgeon and hospital caseload: a population-based study. Colorectal Dis. 2012;14(10):692-700.
Denost Q, Saillour F, Masya L, et al. Benchmarking trial between France and Australia comparing management of primary rectal cancer beyond TME and locally recurrent rectal cancer (PelviCare Trial): rationale and design. BMC Cancer. 2016;16:1-7.
Gietelink L, Henneman D, van Leersum NJ, et al. The influence of hospital volume on circumferential resection margin involvement: results of the Dutch surgical colorectal audit. Ann Surg. 2016;263(4):745-750.
Merkel S, Weber K, Matzel KE, Agaimy A, Gohl J, Hohenberger W. Prognosis of patients with colonic carcinoma before, during and after implementation of complete mesocolic excision. Br J Surg. 2016;103(9):1220-1229.
Atkinson S, Daly M, Midura E, et al. The effect of hospital volume on resection margins in rectal cancer surgery. J Surg Res. 2016;204(1):22-28.
Denost Q, Faucheron J, Lefevre JH, et al. French current management and oncological results of locally recurrent rectal cancer. Eur J Surg Oncol. 2015;41(12):1645-1652.
Massarweh NN, Hu CY, You YN, et al. Risk-adjusted pathologic margin positivity rate as a quality indicator in rectal cancer surgery. J Clin Oncol. 2014;32(27):2967-2974.
Lichliter WE. Techniques in total mesorectal excision surgery. Clin Colon Rectal Surg. 2015;28(1):21-27.
Govindarajan A, Gonen M, Weiser MR, et al. Challenging the feasibility and clinical significance of current guidelines on lymph node examination in rectal cancer in the era of neoadjuvant therapy. J Clin Oncol. 2011;29(34):4568-4573.
Dillman RO, Aaron K, Heinemann FS, McClure SE. Identification of 12 or more lymph nodes in resected colon cancer specimens as an indicator of quality performance. Cancer. 2009;115(9):1840-1848.
Romanus D, Weiser MR, Skibber JM, et al. Concordance with NCCN colorectal cancer guidelines and ASCO/NCCN quality measures: an NCCN institutional analysis. J Natl Compr Canc Netw. 2009;7(8):895-904.
Wang J, Kulaylat M, Rockette H, et al. Should total number of lymph nodes be used as a quality of care measure for stage III colon cancer? Ann Surg. 2009;249(4):559-563.
Blaker H, Hildebrandt B, Riess H, et al. Lymph node count and prognosis in colorectal cancer: the influence of examination quality. Int J Cancer. 2015;136(8):1957-1966.
Mathis KL, Green EM, Sargent DJ, Delaney C, Simmang CL, Nelson H. Surgical quality surrogates do not predict colon cancer survival in the setting of technical credentialing: a report from the prospective COST trial. Ann Surg. 2013;257(1):102-107.
Porter G, Urquhart R, Bu J, Johnson P, Rayson D, Grunfeld E. Improving nodal harvest in colorectal cancer: so what? Ann Surg Oncol. 2012;19(4):1066-1073.
Hechenbleikner E, Makary M, Samarov D, et al. Hospital readmission by method of data collection. J Am Coll Surg. 2013;216(6):1150-1158.
Bilchik A, Nissan A, Wainberg Z, et al. Surgical quality and nodal ultrastaging is associated with long-term disease-free survival in early colorectal cancer: an analysis of 2 international multicenter prospective trials. Ann Surg. 2010;252(3):467-476.
McFadyen C, Lankshear S, Divaris D, et al. Physician level reporting of surgical and pathology performance indicators: a regional study to assess feasibility and impact on quality. Can J Surg. 2015;58(1):31-40.
Nir S, Greenberg R, Shacham-Shmueli E, White I, Schneebaum S, Avital S. Number of retrieved lymph nodes and survival in node-negative patients undergoing laparoscopic colorectal surgery for cancer. Tech Coloproctol. 2010;14(2):147-152.
Pappas DP, Garbus JE, Feuerman M, Reed WP. Improving uniformity of care for colorectal cancers through National Quality Forum quality indicators at a Commission on Cancer-accredited community based teaching hospital. Surg Oncol Clin N Am. 2011;20(3):587-596.
Wong JH, Lum SS, Morgan JW. Lymph node counts as an indicator of quality at the hospital level in colorectal surgery. J Am Coll Surg. 2011;213(2):226-230.
Liu JB, Huffman KM, Palis BE, et al. Reliability of the American College of Surgeons Commission on cancer's quality of care measures for hospital and surgeon profiling. J Am Coll Surg. 2017;224(2):180-190.
Chang Y, Chen L, Chang Y, Chung K, Lai MS. Application of propensity score model to examine the prognostic significance of lymph node number as a care quality indicator. Surg Oncol. 2012;21(2):75-85.
Chien T, Lin Y, Chang C, Tsai MT, Uen YH. Using a bubble chart to enhance adherence to quality-of-care guidelines for colorectal cancer patients. Eur J Cancer Care. 2012;21(6):712-721.
Dejardin O, Ruault E, Jooste V, et al. Volume of surgical activity and lymph node evaluation for patients with colorectal cancer in France. Dig Liver Dis. 2012;44(3):261-267.
Shulman LN, Browner AE, Palis BE, et al. Compliance with cancer quality measures over time and their association with survival outcomes: the commission on cancer's experience with the quality measure requiring at least 12 regional lymph nodes to be removed and analyzed with colon cancer resections. Ann Surg Oncol. 2019;26(6):1613-1621.
Fung-Kee-Fung M, Boushey RP, Watters J, et al. Piloting a regional collaborative in cancer surgery using a “community of practice” model. Curr Oncol. 2014;21(1):27-34.
Steele SR, Chen SL, Stojadinovic A, et al. The impact of age on quality measure adherence in colon cancer. J Am Coll Surg. 2011;213(1):95-105.
Adam M, Turner M, Sun Z, et al. The appropriateness of 30-day mortality as a quality metric in colorectal cancer surgery. Am J Surg. 2018;215(1):66-70.
Stojadinovic A, Nissan A, Wainberg Z, et al. Time-dependent trends in lymph node yield and impact on adjuvant therapy decisions in colon cancer surgery: an international multi-institutional study. Ann Surg Oncol. 2012;19(13):4178-4185.
Marks JH, Valsdottir EB, Rather AA, Nweze IC, Newman DA, Chernick MR. Fewer than 12 lymph nodes can be expected in a surgical specimen after high-dose chemoradiation therapy for rectal cancer. Dis Colon Rectum. 2010;53(7):1023-1029.
Sancho-Muriel J, Frasson M, Hervas D, et al. Standard outcome indicators after colon cancer resection. Creation of a nomogram for autoevaluation. Cir Esp. 2017;95(1):30-37.
Nathan H, Shore AD, Anders RA, Wick EC, Gearhart SL, Pawlik TM. Variation in lymph node assessment after colon cancer resection: patient, surgeon, pathologist, or hospital? J Gastrointest Surg. 2011;15(3):471-479.
Lisovsky M, Schutz SN, Drage MG, Liu X, Suriawinata AA, Srivastava A. Number of lymph nodes in primary nodal basin and a “second look" protocol as quality indicators for optimal nodal staging of colon cancer. Arch Pathol Lab Med. 2017;141(1):125-130.
Boutanos C, Capdepont M, Svrcek M, et al. National multicentric evaluation of quality of pathology reports for rectal cancer in France in 2016. Virchows Archiv. 2019;474(5):561-568.
Kin C, Snyder K, Kiran RP, Remzi FH, Vogel JD. Accidental puncture or laceration in colorectal surgery: a quality indicator or a complexity measure? Dis Colon Rectum. 2013;56(2):219-225.
Peterson CY, Palazzi K, Parsons JK, Chang DC, Ramamoorthy SL. The prevalence of laparoscopy and patient safety outcomes: an analysis of colorectal resections. Surg Endosc. 2014;28(2):608-616.
Hendren S, Birkmeyer JD, Yin H, Banerjee M, Sonnenday C, Morris AM. Surgical complications are associated with omission of chemotherapy for stage III colorectal cancer. Dis Colon Rectum. 2010;53(12):1587-1593.
Almoudaris A, Burns E, Bottle A, et al. Single measures of performance do not reflect overall institutional quality in colorectal cancer surgery. Gut. 2013;62(3):423-429.
Henneman D, Dekker JW, Wouters MW, Fiocco M, Tollenaar RA. Benchmarking clinical outcomes in elective colorectal cancer surgery: the interplay between institutional reoperation- and mortality rates. Eur J Surg Oncol. 2014;40(11):1429-1435.
McSorley S, Lowndes C, Sharma P, Macdonald A. Unplanned reoperation within 30 days of surgery for colorectal cancer in NHS Lanarkshire. Colorectal Dis. 2013;15(6):689-694.
Burns EM, Mamidanna R, Currie A, et al. The role of caseload in determining outcome following laparoscopic colorectal cancer resection: an observational study. Surg Endosc. 2014;28(1):134-142.
Damle R, Macomber C, Flahive J, et al. Surgeon volume and elective resection for colon cancer: an analysis of outcomes and use of laparoscopy. J Am Coll Surg. 2014;218(6):1223-1230.
de la Portilla F, Builes S, Garcia-Novoa A, et al. Analysis of quality indicators for colorectal cancer surgery in units accredited by the Spanish Association of Coloproctology. Cir Esp. 2018;96(4):226-233.
Hofstede SN, Ceyisakar IE, Lingsma HF, Kringos DS, Marang-van de Mheen PJ. Ranking hospitals: do we gain reliability by using composite rather than individual indicators? BMJ Qual Saf. 2019;28(2):94-102.
Gort M, Otter R, Plukker JTM, Broekhuis M, Klazinga NS. Actionable indicators for short and long term outcomes in rectal cancer. Eur J Cancer. 2010;46(10):1808-1814.
Ommundsen N, Nesbakken A, Wyller TB, et al. Post-discharge complications in frail older patients after surgery for colorectal cancer. Eur J Surg Oncol. 2018;44(10):1542-1547.
Xu T, Makary M, Kazzi E, et al. Surgeon-level variation in postoperative complications. J Gastrointest Surg. 2016;20(7):1393-1399.
Merkow RP, Bentrem DJ, Chung JW, Paruch JL, Ko CY, Bilimoria KY. Differences in patients, surgical complexity, and outcomes after cancer surgery at National Cancer Institute-designated cancer centers compared to other hospitals. Med Care. 2013;51(7):606-613.
Hedrick T, Harrigan A, Sawyer R, et al. Defining surgical site infection in colorectal surgery: an objective analysis using serial photographic documentation. Dis Colon Rectum. 2015;58(11):1070-1077.
Murray AC, Pasam R, Estrada D, Kiran RP. Risk of surgical site infection varies based on location of disease and segment of colorectal resection for cancer. Dis Colon Rectum. 2016;59(6):493-500.
Hou X-T, Pang D, Lu Q, et al. Validation of the Chinese version of the low anterior resection syndrome score for measuring bowel dysfunction after sphincter-preserving surgery among rectal cancer patients. Eur J Oncol Nurs. 2015;19(5):495-501.
Hernandez-Boussard TM, McDonald KM, Morrison DE, Rhoads KF. Risks of adverse events in colorectal patients: population-based study. J Surg Res. 2016;202(2):328-334.
Snijders HS, Henneman D, van Leersum NL, et al. Anastomotic leakage as an outcome measure for quality of colorectal cancer surgery. BMJ Qual Saf. 2013;22(9):759-767.
Fischer C, Lingsma HF, van Leersum N, Tollenaar RA, Wouters MW, Steyerberg EW. Comparing colon cancer outcomes: the impact of low hospital case volume and case-mix adjustment. Eur J Surg Oncol. 2015;41(8):1045-1053.
Gruen RL, Pitt V, Green S, Parkhill A, Campbell D, Jolley D. The effect of provider case volume on cancer mortality: systematic review and meta-analysis. CA Cancer J Clin. 2009;59(3):192-211.
Henneman D, van Bommel AC, Snijders A, et al. Ranking and rankability of hospital postoperative mortality rates in colorectal cancer surgery. Ann Surg. 2014;259(5):844-849.
Hureibi K, Evans C, Wong L, Ain Q. Time to rethink surgeon-specific outcome data for colorectal surgeons in England: cross-sectional data of 73,842 resections for colorectal cancer. Int J Surg. 2018;57:101-104.
Mainz J, Hjulsager M, Og MT, Burgaard J. National benchmarking between the Nordic countries on the quality of care. J Surg Oncol. 2009;99(8):505-507.
Osler M, Iversen LH, Borglykke A, et al. Hospital variation in 30-day mortality after colorectal cancer surgery in denmark: the contribution of hospital volume and patient characteristics. Ann Surg. 2011;253(4):733-738.
Zheng H, Zhang W, Ayanian JZ, et al. Profiling hospitals by survival of patients with colorectal cancer. Health Serv Res. 2011;46(3):729-746.
Hofstede SN, van Bodegom-Vos L, Kringos DS, Steyerberg E, Marang-van de Mheen PJ. Mortality, readmission and length of stay have different relationships using hospital-level versus patient-level data: an example of the ecological fallacy affecting hospital performance indicators. BMJ Qual Saf. 2018;27(6):474-483.
Theile DE, Philpot S, Blake M, Harrington J, Youl PH. Outcomes following colorectal cancer surgery: results from a population-based study in Queensland, Australia, using quality indicators. J Eval Clin Pract. 2018;21:21.
Youl P, Philpot S, Theile DE, Cancer Alliance Queensland. Outcomes after rectal cancer surgery: a population-based study using quality indicators. J Healthc Qual. 2019;22:90-100.
Abdelsattar Z, Wong S, Birkmeyer N, et al. Multi-institutional assessment of sphincter preservation for rectal cancer. Ann Surg Oncol. 2014;21(13):4075-4080.
Turner NH, Wong HL, Field K, et al. Novel quality indicators for metastatic colorectal cancer management identify significant variations in these measures across treatment centers in Australia. Asia Pac J Clin Oncol. 2015;11(3):262-271.
Horn ME, Reinke EK, Mather RC, O'Donnell JD, George SZ. Electronic health record-integrated approach for collection of patient-reported outcome measures: a retrospective evaluation. BMC Health Serv Res. 2021;21(1):1-11.