Exploring how key performance indicators influence nursing and midwifery practice: A mixed-methods study.
collective leadership
key performance indicators
midwifery
nursing
quality improvement
Journal
Journal of advanced nursing
ISSN: 1365-2648
Titre abrégé: J Adv Nurs
Pays: England
ID NLM: 7609811
Informations de publication
Date de publication:
Dec 2021
Dec 2021
Historique:
revised:
13
08
2021
received:
07
04
2021
accepted:
07
09
2021
pubmed:
22
9
2021
medline:
17
11
2021
entrez:
21
9
2021
Statut:
ppublish
Résumé
To scope the key performance indicators (KPIs) used in nursing and midwifery across the United Kingdom and Republic of Ireland and explore how they influence practice in healthcare organizations. The study adopted a sequential, exploratory mixed-methods design. Phase 1 incorporated a multiple-choice questionnaire completed by 77 Directors of Nursing recruited using voluntary response sampling. In phase 2, 35 nurses and midwives who were working at executive, senior manager and clinical levels, participated in semi-structured interviews. Data collection of both phases was conducted from January 2016 to October 2016. Quantitative data revealed over 100 nursing and midwifery-specific KPIs. National requirements were a deciding factor in KPI selection, while clinical involvement was mainly through data collection. Respondents stated that they used patient experience KPIs, but only one was assessed as valid. Thematic analysis identified two themes: The leadership challenge (including 'voiceless in the national conversation', 'aligning KPIs in the practice context' and 'listening to those who matter'); and taking action (including 'establishing ownership and engaging staff', 'checks and balances' and 'closing the loop'). The large volume of KPI measurement taking place makes meaningful evaluation of performance and quality of care difficult, both in and across organizations. Nurses and midwives require enhanced knowledge of the nature and purpose of KPIs, as evidence gained from KPI data collection is insufficient to lead to improvements in practice. A practice context that encourages collective leadership, where multiple sources of evidence are gathered and everyone is included in KPI evaluation and subsequent decision-making, is key. This study adds to the body of evidence on KPI understanding. It informs the future effective management of indicators that will facilitate the delivery of meaningful care and reduce the cost, time and effort invested in the implementation of KPIs and data management.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
4900-4918Subventions
Organisme : Belfast Health and Social Care Trust
Organisme : Department for Employment and Learning NI
Informations de copyright
© 2021 John Wiley & Sons Ltd.
Références
Abrahamson, K., Miech, E., Wood Davila, H., Mueller, C., Cooke, V., & Arling, G. (2015). Pay-for-performance policy and data-driven decision making within nursing homes: A qualitative study. British Medical Journal Quality and Safety, 24(5), 311-317. https://doi.org/10.1136/bmjqs-2014-003362
Aiken, L. H., Sloane, D. M., Bruyneel, L., Van den Heede, K., Griffiths, P., Busse, R., Diomidous, M., Kinnunen, J., Kόzka, M., Lesaffre, E., McHugh, M. D., Moreno-Casbas, M. T., Rafferty, A. M., Schwendimann, R., Scott, P. A., Tishelman, C., van Achterberg, T., & Sermeus, W. (2014). Nurse staffing and education and hospital mortality in nine European countries: A retrospective observational study. The Lancet, 383, 1824-1830. https://doi.org/10.1016/S0140-6736(13)62631-8
American Nurses Association. (2019). Historical review. Retrieved from https://www.nursingworld.org/~48de64/globalassets/docs/ana/historical-review2016.pdf
Anseel, F., Lievens, F., Schollaert, E., & Choragwicka, B. (2010). Response rates in organizational science, 1995-2008: A meta-analytic review and guidelines for survey researchers. Journal of Business and Psychology, 25, 335-349. https://doi.org/10.1007/s10869-010-9157-6
Artley, W., & Stroh, S. (2001). The performance-based management handbook, Vol. 2. Performance-Based Management Special Interest Group.
Avinash, K. (2010). Occam’s razor. Retrieved from http://www.kaushik.net/avinash/web-analytics-101-definitions-goals-metrics-kpis-dimensions-targets/
Berwick, D. (2015). Key note address. International Forum on Quality and Safety in Healthcare. Retrieved from http://livestream.com/IFQSH/ForumLIVE
Berwick, D., Loehrer, S., & Gunther-Murphy, C. (2017). Breaking the rules for better care. American Medical Association, 317(21), 2161-2164. https://doi.org/10.1001/jama.2017.4703
Braun, V., & Clarke, V. (2013). Successful qualitative research. SAGE Publications.
Bubb, S. (2014). Winterbourne View - time for change. The Stationery Office.
Burston, S., Chaboyer, W., & Gillespie, B. (2013). Nurse-sensitive indicators suitable to reflect nursing care quality: A review and discussion of issues. Journal of Clinical Nursing, 23, 1785-1795.
Cardiff, S., Sanders, K., Webster, J., & Manley, K. (2020). Guiding lights for effective workplace cultures that are also good places to work. International Practice Development Journal, 10(2), 1-20. https://doi.org/10.19043/ipdj.102.002
Cook, C., Heath, F., & Thompson, R. L. (2000). A meta-analysis of response rates in web-or internet-based surveys. Educational and Psychological Measurement, 60, 821-836. https://doi.org/10.1177/00131640021970934
Department of Health. (2008). High quality care for all - NHS next stage review final report. The Stationery Office.
Department of Health. (2014). NHS five year forward view. Her Majesty’s Stationery Office.
Department of Health. (2017a). Framework for national performance indicators for nursing and midwifery. An Roinn Sláinte.
Department of Health. (2017b). HSC collective leadership strategy. An Roinn Sláinte.
Donaldson, L., Rutter, P., & Henderson, M. (2014). The right time, the right place. Department of Health Social Services and Public Safety. Retrieved from http://www.dhsspsni.gov.uk/donaldsonreport270115.pdf
Dubois, C., D’Amour, D., Pomey, M., Girard, F., & Brault, I. (2013). Conceptualizing performance of nursing care as a prerequisite for better measurement: A systematic and interpretive review. BioMed Central Nursing, 12(1), 1472-6955. Retrieved from www.biomedcentral.com/1472-6955/12/7
Dubois, C., D'amour, D., Brault, I., Dallaire, C., Déry, J., Duhoux, A., Lavoie-Tremblay, M., Mathieu, L., Karemere, H., & Zufferey, A. (2017). Which priority indicators to use to evaluate nursing care performance? Journal of Advanced Nursing, 73(12), 3154-3167.
Egry, E. Y. (2017). How knowledge can impact on the qualification of nursing and health practice? Text and Context Nursing, 26(2), 1-4. https://doi.org/10.1590/0104-07072017002017editorial2
Francis, R. (2013). Report of the Mid Staffordshire NHS Foundation Trust public inquiry. Her Majesty’s Stationery Office.
Greenhalgh, T., Howick, J., & Maskrey, N. (2014). Evidence based medicine: A movement in crisis? British Medical Journal, 348, 3725. https://doi.org/10.1136/bmj.g3725
Greenhalgh, T., Robert, G., MacFarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organisations: Systematic review and recommendations. The Millbank Quarterly, 82(4), 581-629.
Griffiths, P., Jones, S., Maben, J., & Murrells, T. (2008). State of the art metrics for nursing: A rapid appraisal. King’s College London.
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012). Knowledge translation of research findings. Implementation Science, 7, 50. https://doi.org/10.1186/1748-5908-7-50
Guba, E. G. (1981). Criteria for assessing the trustworthiness of naturalistic inquiries. Educational Communication and Technology Journal, 29, 75-91. https://doi.org/10.1007/BF02766777
Ham, C., Berwick, D., & Dixon, J. (2016). Improving quality in the English NHS. A strategy for action. The King’s Fund.
Harvey, G., & Kitson, A. (2016). PARiHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implementation Science, 11, 33. https://doi.org/10.1186/s13012-016-0398-2
Health Information and Quality Authority. (2013). Guidance on developing key performance indicators and minimum data sets to monitor healthcare quality. Version 1.1. Health Information and Quality Authority.
Health Information and Quality Authority. (2015). Report of the investigation into the safety, quality and standards of services provided by the Health Service Executive to patients in the Midland Regional Hospital, Portlaoise. Health Information and Quality Authority.
Heslop, L. (2014). Australian direct care nurses can make cost savings and improve health-care quality if they have access to meaningful data. International Journal of Nursing Practice, 20, 337-338. https://doi.org/10.1111/ijn.12359
Heslop, L., Lu, S., & Xu, X. (2014). Nursing-sensitive indicators: A concept analysis. Journal of Advanced Nursing, 70(11), 2469-2482. https://doi.org/10.1111/jan.12503
Hsieh, H., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277-1288. https://doi.org/10.1177/1049732305276687
Hunt, K., & Lathlean, J. (2015). Sampling. In K. Gerrish, & J. Lathlean (Eds.), The research process in nursing, 7th ed. (pp. 173-184). Wiley Blackwell.
Jones, L., Pomeroy, L., Robert, G., Burnett, S., Anderson, J. E., & Fulop, N. J. (2017). How do hospital boards govern for quality improvement? A mixed methods study of 15 organisations in England. British Medical Journal Quality and Safety, 1-9. Retrieved from http://qualitysafety.bmj.com/content/early/2017/07/07/bmjqs-2016-006433
Kitson, A., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008). Evaluating the successful implementation of evidence into practice using the PARiHS framework: Theoretical and practical challenges. Implementation Science, 3, 1. https://doi.org/10.1186/1748-5908-3-1
Koch, D., Kutz, A., Conca, A., Wenke, J., Schuetz, P., & Mueller, B. (2020). The relevance, feasibility and benchmarking of nursing quality indicators: A Delphi study. Journal of Advanced Nursing, 76, 3483-3494. https://doi.org/10.1111/jan.14560
Kouzes, J., & Posner, B. (2002). The leadership challenge, 3rd ed. Jossey-Bass.
Liberati, E. G., Tarrant, C., Willars, J., Draycott, T., Winter, C., Chew, S., & Dixon-Woods, M. (2019). How to be a very safe maternity unit: An ethnographic study. Social Science and Medicine, 223, 64-73. https://doi.org/10.1016/j.socscimed.2019.01.035
Maben, J. (2008). The art of caring: invisible and subordinated? A response to Juliet Corbin: “Is caring a lost art in nursing?”. International Journal of Nursing Studies, 45, 335-338. https://doi.org/10.1016/j.ijnurstu.2007.09.002
Mannion, R., Freeman, T., Millar, R., & Davies, H. (2016). Effective board governance of safe care: A cross-sectional examination of the breadth and depth of relationships through local case studies and national surveys. NIHR Health Services and Delivery Research, 4(4), 1-200.
Marr, B. (2014). Caution: When KPIs turn to poison. Linkedin. 24 March. Retrieved from https://www.linkedin.com/pulse/20140324073422-64875646-caution-when-kpis-turn-to-poison
Marr, B. (2018). Data-Driven HR. How to use analytics and metrics to drive performance. Kogan Page Limited.
Marshall, M., Pronovost, P., & Dixon-Woods, M. (2013). View point: Promotion of improvement as a science. The Lancet, 381(9864), 419-421. https://doi.org/10.1016/S0140-6736(12)61850-9
Martin, G. P., McKee, L., & Dixon-Woods, M. (2015). Beyond metrics? Utilizing ‘soft intelligence’ for healthcare quality and safety. Social Science and Medicine, 142, 19-26.
McCance, T., Dickson, C. A. W., Daly, L., Boomer, C. A., Brown, D., Lynch, B., MacArthur, J., Mountain, K., & McCormack, B. (2020). Implementing person-centred key performance indicators to strengthen leadership in community nursing: A feasibility study. Journal of Nursing Management, 28(6), 1443-1452. https://doi.org/10.1111/jonm.13107
McCance, T., Hastings, J., & Dowler, H. (2015). Evaluating the use of key performance indicators to evidence the patient experience. Journal of Clinical Nursing, 24, 3084-3094.
McCance, T., Telford, L., Wilson, J., MacLeod, O., & Dowd, A. (2012). Identifying key performance indicators for nursing and midwifery care using a consensus approach. Journal of Clinical Nursing, 21, 1145-1154. https://doi.org/10.1111/j.1365-2702.2011.03820.x
McCance, T., & Wilson, V. (2015). Using person-centred key performance indicators to improve paediatric services: An international venture. International Practice Development Journal, 5, 1-7. https://doi.org/10.19043/ipdj.5SP.010
Morgan, D. L. (2014). Integrating qualitative and quantitative methods: A pragmatic approach. SAGE Publications.
National Advisory Group on the Safety of Patients in England. (2013). A promise to learn - a commitment to act: Improving the safety of patients in England. Department of Health.
National Health Service England. (2018). Report of the review of the quality and outcomes framework in England. Retrieved from https://www.england.nhs.uk/wp-content/uploads/2018/07/quality-outcome-framework-report-of-the-review.pdf
National Health Service Quality Improvement Scotland. (2005). The impact of nursing on patient clinical outcomes. Retrieved from http://www.healthcareimprovementscotland.org/previous_resources/indicators/clinical_indicatiors_-_nursing.aspx
O'Cathain, A., Murphy, E., & Nicholl, J. (2008). The quality of mixed methods studies in health services research. Journal of Health Services Research and Policy, 13(2), 92-98. https://doi.org/10.1258/jhsrp.2007.007074
Ossege, C. (2012). Accountability - are we better off without it? Public Management Review, 14(5), 585-607. https://doi.org/10.1080/14719037.2011.642567
Parlour, R., Slater, P., & Breslin, E. (2013). Health Service Executive North West nursing and midwifery metrics evaluation research report. Health Service Executive.
Patton, M. Q. (2015). Qualitative evaluation and research methods, 4th ed. SAGE Publications.
Phelan, A., & Kirwan, M. (2020). Contextualising missed care in two healthcare inquiries using a socio-ecological systems approach. Journal of Clinical Nursing, 29, 3527-3540. https://doi.org/10.1111/jocn.15391
Qualtrics. (2015). Qualtrics research suite. http://www.qualtrics.com/
Rambur, B., Vallett, C., Cohen, J., & Mattuck Tarule, J. (2013). Metric-driven harm: An exploration of unintended consequences of performance measurement. Applied Nursing Research, 26, 269-272. https://doi.org/10.1016/j.apnr.2013.09.001
Rock, D., & Cross, S. P. (2020). Regional planning for meaningful person-centred care in mental health: context is the signal not the noise. Epidemiology and Psychiatric Sciences, 29(e104), 1-6. https://doi.org/10.1017/S2045796020000153
Royal College of Nursing Scotland. (2016). Measuring success: Principles for a new approach to improving health and wellbeing in Scotland. Royal College of Nursing.
Sierras-Davo, M., Lillo-Crespo, M., Verdu, P., & Karapostoli, A. (2021). Transforming the future healthcare workforce across Europe through improvement science training: A qualitative approach. International Journal of Environmental Research and Public Health, 18(3), 1298. https://doi.org/10.3390/ijerph18031298
Sim, S., Leamy, M., Davies, N., Schnitzler, K., Levenson, R., Mayer, F., Grant, R., Brearley, S., Gourlay, S., Ross, F., & Harris, R. (2018). Realist synthesis of intentional rounding in hospital wards: Exploring the evidence of what works, for whom, in what circumstances and why. British Medical Journal Quality and Safety, 27, 743-757. https://doi.org/10.1136/bmjqs-2017-006757
Sorensen, R., & Iedelma, R. (2010). Accounting for health-care outcomes: Implications for intensive care unit practice and performance. Health Services Management Research, 23, 97-102. https://doi.org/10.1258/hsmr.2009.009020
Timmins, F. (2015). Surveys and questionnaires in nursing research. Nursing Standard, 29(42), 42-50. https://doi.org/10.7748/ns.29.42.42.e8904
Turner, S., D’Lima, D., Hudson, E., Morris, S., Sheringham, J., Swart, N., & Fulop, N. J. (2017). Evidence use in decision-making on introducing innovations: A systematic scoping review with stakeholder feedback. Implementation Science, 12, 145. https://doi.org/10.1186/s13012-017-0669-6
Ward, A., Eng, C., McCue, V., Stewart, R., Strain, K., McCormack, B., Dukhu, S., Thomas, J., & Bulley, C. (2018). What matters versus what’s the matter - exploring perceptions of person-centred practice in nursing and physiotherapy social media communities: A qualitative study. International Practice Development Journal, 8(2), 3. https://doi.org/10.19043/ipdj.82.003
Waring, J., Allen, D., Braithwaite, J., & Sandall, J. (2016). Healthcare quality and safety: A review of policy, practice and research. Sociology of Health and Illness, 38(2), 198-215. https://doi.org/10.1111/1467-9566.12391
West, M., Eckert, R., Steward, K., & Pasmore, B. (2014). Developing collective leadership for health care. The Kings Fund.