Developing Messaging Content for a Physical Activity Smartphone App Tailored to Low-Income Patients: User-Centered Design and Crowdsourcing Approach.
crowdsourcing
mHealth
mobile phone
text messaging
user centered design
Journal
JMIR mHealth and uHealth
ISSN: 2291-5222
Titre abrégé: JMIR Mhealth Uhealth
Pays: Canada
ID NLM: 101624439
Informations de publication
Date de publication:
19 05 2021
19 05 2021
Historique:
received:
09
06
2020
accepted:
13
04
2021
revised:
21
09
2020
entrez:
19
5
2021
pubmed:
20
5
2021
medline:
22
5
2021
Statut:
epublish
Résumé
Text messaging interventions can be an effective and efficient way to improve health behavioral changes. However, most texting interventions are neither tested nor designed with diverse end users, which could reduce their impact, and there is limited evidence regarding the optimal design methodology of health text messages tailored to low-income, low-health literacy populations and non-English speakers. This study aims to combine participant feedback, crowdsourced data, and researcher expertise to develop motivational text messages in English and Spanish that will be used in a smartphone app-based texting intervention that seeks to encourage physical activity in low-income minority patients with diabetes diagnoses and depression symptoms. The design process consisted of 5 phases and was iterative in nature, given that the findings from each step informed the subsequent steps. First, we designed messages to increase physical activity based on the behavior change theory and knowledge from the available evidence. Second, using user-centered design methods, we refined these messages after a card sorting task and semistructured interviews (N=10) and evaluated their likeability during a usability testing phase of the app prototype (N=8). Third, the messages were tested by English- and Spanish-speaking participants on the Amazon Mechanical Turk (MTurk) crowdsourcing platform (N=134). Participants on MTurk were asked to categorize the messages into overarching theoretical categories based on the capability, opportunity, motivation, and behavior framework. Finally, each coauthor rated the messages for their overall quality from 1 to 5. All messages were written at a sixth-grade or lower reading level and culturally adapted and translated into neutral Spanish by bilingual research staff. A total of 200 messages were iteratively refined according to the feedback from target users gathered through user-centered design methods, crowdsourced results of a categorization test, and an expert review. User feedback was leveraged to discard unappealing messages and edit the thematic aspects of messages that did not resonate well with the target users. Overall, 54 messages were sorted into the correct theoretical categories at least 50% of the time in the MTurk categorization tasks and were rated 3.5 or higher by the research team members. These were included in the final text message bank, resulting in 18 messages per motivational category. By using an iterative process of expert opinion, feedback from participants that were reflective of our target study population, crowdsourcing, and feedback from the research team, we were able to acquire valuable inputs for the design of motivational text messages developed in English and Spanish with a low literacy level to increase physical activity. We describe the design considerations and lessons learned for the text messaging development process and provide a novel, integrative framework for future developers of health text messaging interventions.
Sections du résumé
BACKGROUND
Text messaging interventions can be an effective and efficient way to improve health behavioral changes. However, most texting interventions are neither tested nor designed with diverse end users, which could reduce their impact, and there is limited evidence regarding the optimal design methodology of health text messages tailored to low-income, low-health literacy populations and non-English speakers.
OBJECTIVE
This study aims to combine participant feedback, crowdsourced data, and researcher expertise to develop motivational text messages in English and Spanish that will be used in a smartphone app-based texting intervention that seeks to encourage physical activity in low-income minority patients with diabetes diagnoses and depression symptoms.
METHODS
The design process consisted of 5 phases and was iterative in nature, given that the findings from each step informed the subsequent steps. First, we designed messages to increase physical activity based on the behavior change theory and knowledge from the available evidence. Second, using user-centered design methods, we refined these messages after a card sorting task and semistructured interviews (N=10) and evaluated their likeability during a usability testing phase of the app prototype (N=8). Third, the messages were tested by English- and Spanish-speaking participants on the Amazon Mechanical Turk (MTurk) crowdsourcing platform (N=134). Participants on MTurk were asked to categorize the messages into overarching theoretical categories based on the capability, opportunity, motivation, and behavior framework. Finally, each coauthor rated the messages for their overall quality from 1 to 5. All messages were written at a sixth-grade or lower reading level and culturally adapted and translated into neutral Spanish by bilingual research staff.
RESULTS
A total of 200 messages were iteratively refined according to the feedback from target users gathered through user-centered design methods, crowdsourced results of a categorization test, and an expert review. User feedback was leveraged to discard unappealing messages and edit the thematic aspects of messages that did not resonate well with the target users. Overall, 54 messages were sorted into the correct theoretical categories at least 50% of the time in the MTurk categorization tasks and were rated 3.5 or higher by the research team members. These were included in the final text message bank, resulting in 18 messages per motivational category.
CONCLUSIONS
By using an iterative process of expert opinion, feedback from participants that were reflective of our target study population, crowdsourcing, and feedback from the research team, we were able to acquire valuable inputs for the design of motivational text messages developed in English and Spanish with a low literacy level to increase physical activity. We describe the design considerations and lessons learned for the text messaging development process and provide a novel, integrative framework for future developers of health text messaging interventions.
Identifiants
pubmed: 34009130
pii: v9i5e21177
doi: 10.2196/21177
pmc: PMC8173396
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
e21177Informations de copyright
©Laura Elizabeth Pathak, Adrian Aguilera, Joseph Jay Williams, Courtney Rees Lyles, Rosa Hernandez-Ramos, Jose Miramontes, Anupama Gunshekar Cemballi, Caroline Astrid Figueroa. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 19.05.2021.
Références
Psychiatr Serv. 2008 Nov;59(11):1264-72
pubmed: 18971402
Res Social Adm Pharm. 2016 Jul-Aug;12(4):578-91
pubmed: 26525857
J Telemed Telecare. 2004;10(5):282-5
pubmed: 15494086
Nicotine Tob Res. 2015 Jul;17(7):769-75
pubmed: 25143295
Psychol Health Med. 2007 Aug;12(4):485-94
pubmed: 17620212
Diabetes Care. 2017 Oct;40(10):1349-1355
pubmed: 28600309
Ann Emerg Med. 2014 Jun;63(6):745-54.e6
pubmed: 24225332
J Med Internet Res. 2016 Jan 07;18(1):e5
pubmed: 26742999
Prim Care Companion J Clin Psychiatry. 2004;6(3):104-111
pubmed: 15361924
World J Diabetes. 2016 Jun 25;7(12):243-51
pubmed: 27350847
Biomed Instrum Technol. 2012 Fall;Suppl:49-56
pubmed: 23039777
JMIR Mhealth Uhealth. 2019 Aug 29;7(8):e14250
pubmed: 31469083
J Health Commun. 2012;17 Suppl 1:11-21
pubmed: 22548594
J Telemed Telecare. 2010;16(8):458-61
pubmed: 20959393
J Epidemiol Community Health. 2006 Jan;60(1):7-12
pubmed: 16361448
J Consult Clin Psychol. 2020 Jan;88(1):1-13
pubmed: 31697093
Public Health Nurs. 2015 Nov-Dec;32(6):662-70
pubmed: 26032902
Int J Telemed Appl. 2012;2012:871925
pubmed: 23304135
Health Educ Behav. 2004 Apr;31(2):143-64
pubmed: 15090118
Eur J Prev Cardiol. 2014 Apr;21(4):492-9
pubmed: 22605787
JMIR Mhealth Uhealth. 2013 May 07;1(1):e5
pubmed: 25100678
Health Promot Int. 2009 Dec;24(4):416-27
pubmed: 19793763
Health Expect. 2011 Sep;14(3):285-95
pubmed: 20860777
Appl Psychol Health Well Being. 2014 Nov;6(3):347-61
pubmed: 25209956
Annu Rev Public Health. 2015 Mar 18;36:393-415
pubmed: 25785892
JMIR Diabetes. 2017 Jan 17;2(1):e1
pubmed: 30291080
Implement Sci. 2011 Apr 23;6:42
pubmed: 21513547
J Health Commun. 2015 Apr;20(4):472-8
pubmed: 25749250
JMIR Mhealth Uhealth. 2015 Feb 18;3(1):e19
pubmed: 25693595
Diabetes Care. 2005 Nov;28(11):2668-72
pubmed: 16249537
Ann Behav Med. 2009 Aug;38(1):18-27
pubmed: 19802647
BMJ Open. 2020 Aug 20;10(8):e034723
pubmed: 32819981
J Med Internet Res. 2012 Jul 24;14(4):e103
pubmed: 22832182
Neuropsychobiology. 2013;67(2):61-8
pubmed: 23295766
JMIR Res Protoc. 2015 May 06;4(2):e51
pubmed: 25947953
Worldviews Evid Based Nurs. 2013 Aug;10(3):163-73
pubmed: 23746267
Diabetes Care. 2003 Aug;26(8):2311-7
pubmed: 12882854
JAMIA Open. 2019 Oct 11;2(4):489-497
pubmed: 32025646