One for all? Assessing the quality of Italian hospital care with the "benefit of the doubt" composite indicator methods.
Journal
Health economics review
ISSN: 2191-1991
Titre abrégé: Health Econ Rev
Pays: Germany
ID NLM: 101583209
Informations de publication
Date de publication:
04 Oct 2024
04 Oct 2024
Historique:
received:
03
04
2024
accepted:
16
09
2024
medline:
4
10
2024
pubmed:
4
10
2024
entrez:
4
10
2024
Statut:
epublish
Résumé
Quality assessment in healthcare systems is challenging due to the multidimensional nature of healthcare services. This study evaluates the overall quality provided by hospitals using composite indicators under the Benefit of the Doubt (BoD) approach, which determines the weights of the indicators with minimal assumptions. We used data from 2015-2020 for Italian Local Health Authorities (LHAs) for 21 outcome measures, applying various non-parametric methods to address aggregation and weighting challenges. Our results show that the BoD measures are robust and effectively capture the dynamics of the quality of LHA, even during external shocks such as the COVID-19 pandemic. This research highlights the importance of methodological choices in the construction of composite indicators and demonstrates the effectiveness of the BoD approach in providing a comprehensive measure of healthcare quality.
Identifiants
pubmed: 39365504
doi: 10.1186/s13561-024-00559-7
pii: 10.1186/s13561-024-00559-7
doi:
Types de publication
Journal Article
Langues
eng
Pagination
83Subventions
Organisme : European Commission
ID : GRINS PE00000018 - CUP E63C22002120006
Organisme : European Commission
ID : GRINS PE00000018 - CUP E63C22002120006
Informations de copyright
© 2024. The Author(s).
Références
Beaussier A, Demeritt D, Griffiths A, Rothstein H. Steering by their own lights: Why regulators across Europe use different indicators to measure healthcare quality. Health Policy. 2020;124:501–10.
doi: 10.1016/j.healthpol.2020.02.012
pubmed: 32192738
pmcid: 7677115
Ben Lahouel B, Ben Zaied Y, Taleb L, Kočišová K. The assessment of socio-environmental performance change: A Benefit of the Doubt indicator based on Directional Distance Function and Malmquist productivity index. Finance Res Lett. 2022;49:103164.
doi: 10.1016/j.frl.2022.103164
Bouveyron C, Côme E, Jacques J, et al. The discriminative functional mixture model for a comparative analysis of bike sharing systems. Ann Appl Stat. 2015;9(4):1726–60.
doi: 10.1214/15-AOAS861
Bouveyron C, Jacques J. Model-based clustering of time series in group-specific functional subspaces. Adv Data Anal Classif. 2011;5(4):281–300.
doi: 10.1007/s11634-011-0095-6
Bouveyron C, Jacques J. funFEM: an R package for functional data clustering. Quatrième Rencontres R. Grenoble; 2015.
Cazals C, Florens J, Simar L. Nonparametric frontier estimation: A robust approach. J Econ. 2002;106(1):1–25.
doi: 10.1016/S0304-4076(01)00080-X
Charnes A, Cooper WW, Rhodes E. Measuring the efficiency of decision making units. Eur J Oper Res. 1978;2(6):429–44.
doi: 10.1016/0377-2217(78)90138-8
Cherchye L, Knox Lovell CA, Moesen W, Van Puyenbroeck T. One market, one number? A composite indicator assessment of EU internal market dynamics. Eur Econ Rev. 2007;51(3):749–79.
doi: 10.1016/j.euroecorev.2006.03.011
Daraio C, Simar L. Introducing environmental variables in nonparametric frontier models: a probabilistic approach. J Prod Anal. 2005;24(1):93–121.
doi: 10.1007/s11123-005-3042-8
Daraio C, Simar L. Advanced robust and nonparametric methods in efficiency analysis. New York: Springer; 2007.
De Belvis AG, Meregaglia M, Morsella A, Adduci A, Perilli A, Cascini F, et al. Italy. Health system review 2022. World Health Organization. Regional Office for Europe - European Observatory on Health Systems and Policies. Copenhagen: WHO Regional Office for Europe; 2022.
De Witte K, Schiltz F. Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach. Eur J Oper Res. 2018;267(3):1172–81.
doi: 10.1016/j.ejor.2017.12.034
Donabedian A. Evaluating the Quality of Medical Care. Milbank Memorial Fund Q. 1966;44(3):166–206.
doi: 10.2307/3348969
Fare R, Karagiannis G, Hasannasab M, Margaritis D. A benefit-of-the-doubt model with reverse indicators. Eur J Oper Res. 2019;278(2):394–400.
doi: 10.1016/j.ejor.2019.02.009
Fusco E. Potential improvements approach in composite indicators construction: The Multi-directional Benefit of the Doubt model. Socio Econ Plan Sci. 2023;85:101447.
doi: 10.1016/j.seps.2022.101447
Fusco E, Vidoli F, Rogge N. Spatial directional robust Benefit of the Doubt approach in presence of undesirable output: An application to Italian waste sector. Omega. 2020;94:102053.
doi: 10.1016/j.omega.2019.03.011
Fusco E, Vidoli F, Sahoo BK. Spatial heterogeneity in composite indicator: A methodological proposal. Omega. 2018;77(C):1–14.
Greco S, Ishizaka A, Matarazzo B, Torrisi G. Stochastic multi-attribute acceptability analysis (SMAA): an application to the ranking of Italian regions. Reg Stud. 2018;52(4):585–600.
doi: 10.1080/00343404.2017.1347612
Greco S, Ishizaka A, Tasiou M, Torrisi G. On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness. Soc Indic Res. 2019;141:61–94.
doi: 10.1007/s11205-017-1832-9
Jacobs R, Smith P, Goddard MK. Measuring performance: an examination of composite performance indicators: a report for the Department of Health. New York: Centre of Health Economics, University of York; 2004.
Kara P, Valentin JB, Mainz J, Johnsen SP. Composite measures of quality of health care: Evidence mapping of methodology and reporting. PLoS ONE. 2022;17:1–21.
doi: 10.1371/journal.pone.0268320
Karagiannis G, Sarris A. Measuring and explaining scale efficiency with the parametric approach: the case of Greek tobacco growers. Agric Econ. 2005;33(s3):441–51.
doi: 10.1111/j.1574-0864.2005.00084.x
Lagravinese R, Paolo L, Resce G. Exploring health outcomes by stochastic multicriteria acceptability analysis: An application to Italian regions. Eur J Oper Res. 2019;274(3):1168–79.
doi: 10.1016/j.ejor.2018.11.009
Lavigne C, De Jaeger S, Rogge N. Identifying the most relevant peers for benchmarking waste management performance: A conditional directional distance Benefit-of-the-Doubt approach. Waste Manag. 2019;89:418–29.
doi: 10.1016/j.wasman.2019.04.006
pubmed: 31079756
Mazziotta M, Pareto A. On a Generalized Non-compensatory Composite Index for Measuring Socio-economic Phenomena. Soc Indic Res. 2016;127(3):983–1003.
doi: 10.1007/s11205-015-0998-2
Melyn W, Moesen W. Towards a synthetic indicator of macroeconomic performance: unequal weighting when limited information is available. Public Econ Res Pap. 1991;1–24.
Oliveira R, Zanella A, Camanho AS. A temporal progressive analysis of the social performance of mining firms based on a Malmquist index estimated with a Benefit-of-the-Doubt directional model. J Clean Prod. 2020;267:121807.
doi: 10.1016/j.jclepro.2020.121807
Ramsay JO, Silverman BW. Functional data analysis. Springer Series in Statistics. New York: Springer; 2005.
doi: 10.1007/b98888
Rogge N. Composite indicators as generalized benefit-of-the-doubt weighted averages. Eur J Oper Res. 2018;267(1):381–92.
doi: 10.1016/j.ejor.2017.11.048
Rogge N. On aggregating Benefit of the Doubt composite indicators. Eur J Oper Res. 2018;264(1):364–9.
doi: 10.1016/j.ejor.2017.06.035
Rogge N, De Jaeger S, Lavigne C. Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model. Ecol Econ. 2017;139:19–32.
doi: 10.1016/j.ecolecon.2017.03.021
Van Puyenbroeck T, Rogge N. Geometric mean quantity index numbers with Benefit-of-the-Doubt weights. Eur J Oper Res. 2017;256(3):1004–14.
doi: 10.1016/j.ejor.2016.07.038
Verbunt P, Rogge N. Geometric composite indicators with compromise Benefit-of-the-Doubt weights. Eur J Oper Res. 2018;264(1):388–401.
doi: 10.1016/j.ejor.2017.06.061
Vidoli F, Fusco E, Mazziotta C. Non-compensability in Composite Indicators: A Robust Directional Frontier Method. Soc Indic Res. 2015;122(3):635–52.
doi: 10.1007/s11205-014-0710-y
Vidoli F, Fusco E, Pignataro G, Guccio C. Multi-directional Robust Benefit of the Doubt model: An application to the measurement of the quality of acute care services in OECD countries. Socio Econ Plan Sci. 2024;93:101877.
doi: 10.1016/j.seps.2024.101877