Developing Ethics and Equity Principles, Terms, and Engagement Tools to Advance Health Equity and Researcher Diversity in AI and Machine Learning: Modified Delphi Approach.

AI Delphi ML artificial intelligence disparities disparity engagement equitable equities equity ethic ethical ethics fair fairness health disparities health equity humanitarian machine learning

Journal

JMIR AI
ISSN: 2817-1705
Titre abrégé: JMIR AI
Pays: Canada
ID NLM: 9918645789006676

Informations de publication

Date de publication:
06 Dec 2023
Historique:
received: 18 09 2023
accepted: 05 11 2023
revised: 01 11 2023
medline: 14 6 2024
pubmed: 14 6 2024
entrez: 14 6 2024
Statut: epublish

Résumé

Artificial intelligence (AI) and machine learning (ML) technology design and development continues to be rapid, despite major limitations in its current form as a practice and discipline to address all sociohumanitarian issues and complexities. From these limitations emerges an imperative to strengthen AI and ML literacy in underserved communities and build a more diverse AI and ML design and development workforce engaged in health research. AI and ML has the potential to account for and assess a variety of factors that contribute to health and disease and to improve prevention, diagnosis, and therapy. Here, we describe recent activities within the Artificial Intelligence/Machine Learning Consortium to Advance Health Equity and Researcher Diversity (AIM-AHEAD) Ethics and Equity Workgroup (EEWG) that led to the development of deliverables that will help put ethics and fairness at the forefront of AI and ML applications to build equity in biomedical research, education, and health care. The AIM-AHEAD EEWG was created in 2021 with 3 cochairs and 51 members in year 1 and 2 cochairs and ~40 members in year 2. Members in both years included AIM-AHEAD principal investigators, coinvestigators, leadership fellows, and research fellows. The EEWG used a modified Delphi approach using polling, ranking, and other exercises to facilitate discussions around tangible steps, key terms, and definitions needed to ensure that ethics and fairness are at the forefront of AI and ML applications to build equity in biomedical research, education, and health care. The EEWG developed a set of ethics and equity principles, a glossary, and an interview guide. The ethics and equity principles comprise 5 core principles, each with subparts, which articulate best practices for working with stakeholders from historically and presently underrepresented communities. The glossary contains 12 terms and definitions, with particular emphasis on optimal development, refinement, and implementation of AI and ML in health equity research. To accompany the glossary, the EEWG developed a concept relationship diagram that describes the logical flow of and relationship between the definitional concepts. Lastly, the interview guide provides questions that can be used or adapted to garner stakeholder and community perspectives on the principles and glossary. Ongoing engagement is needed around our principles and glossary to identify and predict potential limitations in their uses in AI and ML research settings, especially for institutions with limited resources. This requires time, careful consideration, and honest discussions around what classifies an engagement incentive as meaningful to support and sustain their full engagement. By slowing down to meet historically and presently underresourced institutions and communities where they are and where they are capable of engaging and competing, there is higher potential to achieve needed diversity, ethics, and equity in AI and ML implementation in health research.

Sections du résumé

BACKGROUND BACKGROUND
Artificial intelligence (AI) and machine learning (ML) technology design and development continues to be rapid, despite major limitations in its current form as a practice and discipline to address all sociohumanitarian issues and complexities. From these limitations emerges an imperative to strengthen AI and ML literacy in underserved communities and build a more diverse AI and ML design and development workforce engaged in health research.
OBJECTIVE OBJECTIVE
AI and ML has the potential to account for and assess a variety of factors that contribute to health and disease and to improve prevention, diagnosis, and therapy. Here, we describe recent activities within the Artificial Intelligence/Machine Learning Consortium to Advance Health Equity and Researcher Diversity (AIM-AHEAD) Ethics and Equity Workgroup (EEWG) that led to the development of deliverables that will help put ethics and fairness at the forefront of AI and ML applications to build equity in biomedical research, education, and health care.
METHODS METHODS
The AIM-AHEAD EEWG was created in 2021 with 3 cochairs and 51 members in year 1 and 2 cochairs and ~40 members in year 2. Members in both years included AIM-AHEAD principal investigators, coinvestigators, leadership fellows, and research fellows. The EEWG used a modified Delphi approach using polling, ranking, and other exercises to facilitate discussions around tangible steps, key terms, and definitions needed to ensure that ethics and fairness are at the forefront of AI and ML applications to build equity in biomedical research, education, and health care.
RESULTS RESULTS
The EEWG developed a set of ethics and equity principles, a glossary, and an interview guide. The ethics and equity principles comprise 5 core principles, each with subparts, which articulate best practices for working with stakeholders from historically and presently underrepresented communities. The glossary contains 12 terms and definitions, with particular emphasis on optimal development, refinement, and implementation of AI and ML in health equity research. To accompany the glossary, the EEWG developed a concept relationship diagram that describes the logical flow of and relationship between the definitional concepts. Lastly, the interview guide provides questions that can be used or adapted to garner stakeholder and community perspectives on the principles and glossary.
CONCLUSIONS CONCLUSIONS
Ongoing engagement is needed around our principles and glossary to identify and predict potential limitations in their uses in AI and ML research settings, especially for institutions with limited resources. This requires time, careful consideration, and honest discussions around what classifies an engagement incentive as meaningful to support and sustain their full engagement. By slowing down to meet historically and presently underresourced institutions and communities where they are and where they are capable of engaging and competing, there is higher potential to achieve needed diversity, ethics, and equity in AI and ML implementation in health research.

Identifiants

pubmed: 38875540
pii: v2i1e52888
doi: 10.2196/52888
doi:

Types de publication

Journal Article

Langues

eng

Pagination

e52888

Informations de copyright

©Rachele Hendricks-Sturrup, Malaika Simmons, Shilo Anders, Kammarauche Aneni, Ellen Wright Clayton, Joseph Coco, Benjamin Collins, Elizabeth Heitman, Sajid Hussain, Karuna Joshi, Josh Lemieux, Laurie Lovett Novak, Daniel J Rubin, Anil Shanker, Talitha Washington, Gabriella Waters, Joyce Webb Harris, Rui Yin, Teresa Wagner, Zhijun Yin, Bradley Malin. Originally published in JMIR AI (https://ai.jmir.org), 06.12.2023.

Auteurs

Rachele Hendricks-Sturrup (R)

National Alliance Against Disparities in Patient Health, Woodbridge, VA, United States.

Malaika Simmons (M)

National Alliance Against Disparities in Patient Health, Woodbridge, VA, United States.

Shilo Anders (S)

Vanderbilt University Medical Center, Nashville, TN, United States.

Kammarauche Aneni (K)

Yale University, New Haven, CT, United States.

Ellen Wright Clayton (E)

Vanderbilt University Medical Center, Nashville, TN, United States.

Joseph Coco (J)

Vanderbilt University Medical Center, Nashville, TN, United States.

Benjamin Collins (B)

Vanderbilt University Medical Center, Nashville, TN, United States.

Elizabeth Heitman (E)

University of Texas Southwestern Medical Center, Dallas, TX, United States.

Sajid Hussain (S)

Fisk University, Nashville, TN, United States.

Karuna Joshi (K)

University of Maryland, Baltimore County, Baltimore, MD, United States.

Josh Lemieux (J)

OCHIN, Portland, OR, United States.

Laurie Lovett Novak (L)

Vanderbilt University Medical Center, Nashville, TN, United States.

Daniel J Rubin (DJ)

Temple University, Philadelphia, PA, United States.

Anil Shanker (A)

Meharry Medical College, Nashville, TN, United States.

Talitha Washington (T)

AUC Data Science Initiative, Clark Atlanta University, Atlanta, GA, United States.

Gabriella Waters (G)

Morgan State University, Center for Equitable AI & Machine Learning Systems, Baltimore, MD, United States.

Joyce Webb Harris (J)

Vanderbilt University Medical Center, Nashville, TN, United States.

Rui Yin (R)

University of Florida, Gainesville, FL, United States.

Teresa Wagner (T)

University of North Texas Health Science Center, SaferCare Texas, Fort Worth, TX, United States.

Zhijun Yin (Z)

Vanderbilt University Medical Center, Nashville, TN, United States.

Bradley Malin (B)

Vanderbilt University Medical Center, Nashville, TN, United States.

Classifications MeSH