How should artificial intelligence be used in Australian health care? Recommendations from a citizens' jury.
Artificial intelligence
Health policy
Healthcare disparities
Journal
The Medical journal of Australia
ISSN: 1326-5377
Titre abrégé: Med J Aust
Pays: Australia
ID NLM: 0400714
Informations de publication
Date de publication:
17 Apr 2024
17 Apr 2024
Historique:
received:
30
06
2023
accepted:
06
11
2023
medline:
17
4
2024
pubmed:
17
4
2024
entrez:
17
4
2024
Statut:
aheadofprint
Résumé
To support a diverse sample of Australians to make recommendations about the use of artificial intelligence (AI) technology in health care. Citizens' jury, deliberating the question: "Under which circumstances, if any, should artificial intelligence be used in Australian health systems to detect or diagnose disease?" Thirty Australian adults recruited by Sortition Foundation using random invitation and stratified selection to reflect population proportions by gender, age, ancestry, highest level of education, and residential location (state/territory; urban, regional, rural). The jury process took 18 days (16 March - 2 April 2023): fifteen days online and three days face-to-face in Sydney, where the jurors, both in small groups and together, were informed about and discussed the question, and developed recommendations with reasons. Jurors received extensive information: a printed handbook, online documents, and recorded presentations by four expert speakers. Jurors asked questions and received answers from the experts during the online period of the process, and during the first day of the face-to-face meeting. Jury recommendations, with reasons. The jurors recommended an overarching, independently governed charter and framework for health care AI. The other nine recommendation categories concerned balancing benefits and harms; fairness and bias; patients' rights and choices; clinical governance and training; technical governance and standards; data governance and use; open source software; AI evaluation and assessment; and education and communication. The deliberative process supported a nationally representative sample of citizens to construct recommendations about how AI in health care should be developed, used, and governed. Recommendations derived using such methods could guide clinicians, policy makers, AI researchers and developers, and health service users to develop approaches that ensure trustworthy and responsible use of this technology.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Subventions
Organisme : National Health and Medical Research Council
ID : NHMRC 1181960
Informations de copyright
© 2024 The Authors. Medical Journal of Australia published by John Wiley & Sons Australia, Ltd on behalf of AMPCo Pty Ltd.
Références
Australian Department of Industry, Science and Resources. Supporting responsible AI: discussion paper. Government's interim response. 17 Jan 2024. https://consult.industry.gov.au/supporting‐responsible‐ai (viewed Mar 2024).
Lyell D, Wang Y, Coiera E, Magrabi F. More than algorithms: an analysis of safety events involving ML‐enabled medical devices reported to the FDA. J Am Med Inform Assoc 2023; 30: 1227‐1226.
Wadie J. A roadmap for artificial intelligence in healthcare for Australia news]. Australian Alliance for Artificial Intelligence in Healthcare, 1 Dec 2021. https://aihealthalliance.org/2021/12/01/a‐roadmap‐for‐ai‐in‐healthcare‐for‐australia (viewed Oct 2023).
Coiera EW, Verspoor K, Hansen DP. We need to chat about artificial intelligence. Med J Aust 2023; 219: 98‐100. https://www.mja.com.au/journal/2023/219/3/we‐need‐chat‐about‐artificial‐intelligence
Pearce C, McLeod A, Rinehart N, et al. Artificial intelligence and the clinical world: a view from the front line. Med J Aust 2019; 210 (6 Suppl): S38‐S40. https://www.mja.com.au/journal/2019/210/6/artificial‐intelligence‐and‐clinical‐world‐view‐front‐line
Moodie C. Australian Medical Association calls for national regulations around AI in health care. ABC News (Australia), 28 May 2023. https://www.abc.net.au/news/2023‐05‐28/ama‐calls‐for‐national‐regulations‐for‐ai‐in‐health/102381314 (viewed Oct 2023).
Mathews DJH, Balatbat CA, Dzau VJ. Governance of emerging technologies in health and medicine: creating a new framework. N Engl J Med 2022; 386: 2239‐2242.
Degeling C, Carter SM, Rychetnik L. Which public and why deliberate? A scoping review of public deliberation in public health and health policy research. Soc Sci Med 2015; 131: 114‐121.
Flanigan B, Gölz P, Gupta A, et al. Fair algorithms for selecting citizens’ assemblies. Nature 2021; 596: 548‐552.
Australian Centre for Health Engagement Evidence and Values. Artificial intelligence in health: community jury. Undated. https://uow.info/TAWSYN_JURY (viewed Oct 2023).
White K, Hunter N, Greaves K. Facilitating deliberation: a practical guide. Melbourne: MosaicLab, 2022.
Brown J, Isaacs D. The world café: shaping our futures through conversations that matter. San Francisco: Berrett–Koehler, 2005.
Aquino YSJ, Carter SM, Houssami N, et al. Practical, epistemic and normative implications of algorithmic bias in healthcare artificial intelligence: a qualitative study of multidisciplinary expert perspectives. J Med Ethics 2023: jme‐2022‐108850.
Thomas R, Sims R, Degeling C, et al. CJCheck Stage 1: development and testing of a checklist for reporting community juries: Delphi process and analysis of studies published in 1996–2015. Health Expect 2016; 20: 626‐637.
Australian Bureau of Statistics. Snapshot of Australia, 2021. 28 June 2022. https://www.abs.gov.au/statistics/people/people‐and‐communities/snapshot‐australia/2021 (viewed Oct 2023).
Australian Bureau of Statistics. Education and training: census, 2021. 28 June 2022. https://www.abs.gov.au/statistics/people/education/education‐and‐training‐census/latest‐release (viewed Oct 2023).
Australian Bureau of Statistics. National state and territory population, December 2023. 28 June 2022. https://www.abs.gov.au/statistics/people/population/national‐state‐and‐territory‐population/dec‐2021 (viewed Oct 2023).
Australian Institute of Health and Welfare. Profile of Australia's population. 6 June 2023. https://www.aihw.gov.au/reports/australias‐health/profile‐of‐australias‐population (viewed Oct 2023).
van der Veer SN, Riste L, Cheraghi‐Sohi S, et al. Trading off accuracy and explainability in AI decision‐making: findings from 2 citizens’ juries. J Am Med Inform Assoc 2021; 28: 2128‐2138.
Forum for Ethical AI. Democratising decisions about technology: a toolkit. 24 Oct 2019. https://www.thersa.org/reports/democratising‐decisions‐technology‐toolkit (viewed Oct 2023).
Ada Lovelace Institute. The Citizens’ Biometrics Council London: report with recommendations and findings of a public deliberation on biometrics technology, policy and governance. 30 Mar 2021. https://www.adalovelaceinstitute.org/report/citizens‐biometrics‐council (viewed Oct 2023).
European Commission. Proposal for a regulation of the European parliament and the council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain union legislative acts (COM/2021/206 final). 21 Apr 2021. https://eur‐lex.europa.eu/legal‐content/EN/TXT/?uri=CELEX:52021PC0206 (viewed Oct 2023).
Therapeutic Goods Administration. Regulation of software based medical devices. 28 Sept 2023. https://www.tga.gov.au/how‐we‐regulate/manufacturing/medical‐devices/manufacturer‐guidance‐specific‐types‐medical‐devices/regulation‐software‐based‐medical‐devices (viewed Oct 2023).
Street J, Duszynski K, Krawczyk S, Braunack‐Mayer A. The use of citizens' juries in health policy decision‐making: a systematic review. Soc Sci Med 2014; 109: 1‐9.