Human factors methods in the design of digital decision support systems for population health: a scoping review.
Decision-making tool
Human factors engineering
Literature review
Public health
User-centered design
Journal
BMC public health
ISSN: 1471-2458
Titre abrégé: BMC Public Health
Pays: England
ID NLM: 100968562
Informations de publication
Date de publication:
10 Sep 2024
10 Sep 2024
Historique:
received:
03
04
2024
accepted:
02
09
2024
medline:
11
9
2024
pubmed:
11
9
2024
entrez:
10
9
2024
Statut:
epublish
Résumé
While Human Factors (HF) methods have been applied to the design of decision support systems (DSS) to aid clinical decision-making, the role of HF to improve decision-support for population health outcomes is less understood. We sought to comprehensively understand how HF methods have been used in designing digital population health DSS. We searched English documents published in health sciences and engineering databases (Medline, Embase, PsychINFO, Scopus, Comendex, Inspec, IEEE Xplore) between January 1990 and September 2023 describing the development, validation or application of HF principles to decision support tools in population health. We identified 21,581 unique records and included 153 studies for data extraction and synthesis. We included research articles that had a target end-user in population health and that used HF. HF methods were applied throughout the design lifecycle. Users were engaged early in the design lifecycle in the needs assessment and requirements gathering phase and design and prototyping phase with qualitative methods such as interviews. In later stages in the lifecycle, during user testing and evaluation, and post deployment evaluation, quantitative methods were more frequently used. However, only three studies used an experimental framework or conducted A/B testing. While HF have been applied in a variety of contexts in the design of data-driven DSSs for population health, few have used Human Factors to its full potential. We offer recommendations for how HF can be leveraged throughout the design lifecycle. Most crucially, system designers should engage with users early on and throughout the design process. Our findings can support stakeholders to further empower public health systems.
Sections du résumé
BACKGROUND
BACKGROUND
While Human Factors (HF) methods have been applied to the design of decision support systems (DSS) to aid clinical decision-making, the role of HF to improve decision-support for population health outcomes is less understood. We sought to comprehensively understand how HF methods have been used in designing digital population health DSS.
MATERIALS AND METHODS
METHODS
We searched English documents published in health sciences and engineering databases (Medline, Embase, PsychINFO, Scopus, Comendex, Inspec, IEEE Xplore) between January 1990 and September 2023 describing the development, validation or application of HF principles to decision support tools in population health.
RESULTS
RESULTS
We identified 21,581 unique records and included 153 studies for data extraction and synthesis. We included research articles that had a target end-user in population health and that used HF. HF methods were applied throughout the design lifecycle. Users were engaged early in the design lifecycle in the needs assessment and requirements gathering phase and design and prototyping phase with qualitative methods such as interviews. In later stages in the lifecycle, during user testing and evaluation, and post deployment evaluation, quantitative methods were more frequently used. However, only three studies used an experimental framework or conducted A/B testing.
CONCLUSIONS
CONCLUSIONS
While HF have been applied in a variety of contexts in the design of data-driven DSSs for population health, few have used Human Factors to its full potential. We offer recommendations for how HF can be leveraged throughout the design lifecycle. Most crucially, system designers should engage with users early on and throughout the design process. Our findings can support stakeholders to further empower public health systems.
Identifiants
pubmed: 39256672
doi: 10.1186/s12889-024-19968-8
pii: 10.1186/s12889-024-19968-8
doi:
Types de publication
Journal Article
Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
2458Informations de copyright
© 2024. The Author(s).
Références
Bonczek RH, Holsapple CW, Whinston AB. Foundations of decision support systems. Academic; 2014.
Lee JD, Wickens CD, Liu Y, Boyle LN. Designing for people: an introduction to human factors engineering. CreateSpace; 2017.
Harrison S, Tatar D, Sengers P. The three paradigms of HCI. Alt Chi Session at the SIGCHI Conference on human factors in computing systems San Jose, California, USA. 2007. pp. 1–18.
Meister D. Human factors testing and evaluation. Elsevier; 2014.
Salah D, Paige RF, Cairns P. A systematic literature review for agile development processes and user centred design integration. Proceedings of the 18th international conference on evaluation and assessment in software engineering. 2014. pp. 1–10.
Salwei ME, Carayon P, Hoonakker PLT, Hundt AS, Wiegmann D, Pulia M, et al. Workflow integration analysis of a human factors-based clinical decision support in the emergency department. Appl Ergon. 2021;97:103498.
pubmed: 34182430
pmcid: 8474147
doi: 10.1016/j.apergo.2021.103498
Carayon P, Hoonakker P, Hundt AS, Salwei M, Wiegmann D, Brown RL, et al. Application of human factors to improve usability of clinical decision support for diagnostic decision-making: a scenario-based simulation study. BMJ Qual Saf. 2020;29:329–40.
pubmed: 31776197
doi: 10.1136/bmjqs-2019-009857
Karsh B-T. Clinical practice improvement and redesign: how change in workflow can be supported by clinical decision support. Volume 200943. Rockville, MD: Agency for Healthcare Research and Quality; 2009.
Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L, et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inf Assoc. 2003;10:523–30.
doi: 10.1197/jamia.M1370
Sittig DF, Belmont E, Singh H. Improving the safety of health information technology requires shared responsibility: It is time we all step up. Healthcare [Internet]. 2018;6:7–12. http://www.journals.elsevier.com/healthcare-the-journal-of-delivery-science-and-innovation
Kilsdonk E, Peute LW, Jaspers MWM. Factors influencing implementation success of guideline-based clinical decision support systems: a systematic review and gaps analysis. Int J Med Inf. 2017;98:56–64.
doi: 10.1016/j.ijmedinf.2016.12.001
Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8:19–32.
doi: 10.1080/1364557032000119616
Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5:1–9.
doi: 10.1186/1748-5908-5-69
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1–9.
pubmed: 25554246
pmcid: 4320440
doi: 10.1186/2046-4053-4-1
Rethlefsen ML, Kirtley S, Waffenschmidt S, Ayala AP, Moher D, Page MJ, et al. PRISMA-S: an extension to the PRISMA statement for reporting literature searches in systematic reviews. Syst Rev. 2021;10:1–19.
doi: 10.1186/s13643-020-01542-z
Vasquez HM, Pianarosa E, Sirbu R, Diemert LM, Cunningham HV, Donmez B et al. Human factors applications in the design of decision support systems for population health: a scoping review. BMJ Open [Internet]. 2022;12. https://bmjopen.bmj.com/content/12/4/e054330
Revere D, Dixon BE, Hills R, Williams JL, Grannis SJ. Leveraging health information exchange to improve population health reporting processes: lessons in using a collaborative-participatory design process. EGEMS (Wash DC). 2014;2:1082.
pubmed: 25848615
Pike I, Smith J, Al-Hajj S, Fuselli P, Macpherson A. The Canadian atlas of child and youth injury: mobilizing injury surveillance data to launch a national knowledge translation tool. Int J Environ Res Public Health. 2017;14:982.
pubmed: 28867782
pmcid: 5615519
doi: 10.3390/ijerph14090982
de Lima TFM, Lana RM, Carneiro TGS, Codeço CT, Machado GS, Ferreira LS et al. Dengueme: a tool for the modeling and simulation of dengue spatiotemporal dynamics. Int J Environ Res Public Health. 2016;13.
Ola O, Sedig K. Beyond simple charts: design of visualizations for big health data. Online J Public Health Inf. 2016;8.
Yuan M, Powell G, Lavigne M, Okhmatovskaia A, Buckeridge DL. Initial Usability Evaluation of a Knowledge-Based Population Health Information System: The Population Health Record (PopHR). AMIA Annu Symp Proc [Internet]. 2017;2017:1878–84. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85058748371&partnerID=40&md5=b859b042f33ad16f747528f271aacac0
Al-Hajj S, Pike I, Riecke BE, Fisher B. Visual analytics for public health: Supporting knowledge construction and decision-making. Proceedings of the Annual Hawaii International Conference on System Sciences. 2013. pp. 2416–23.
Scotch M, Parmanto B, Monaco V. Usability Evaluation of the Spatial OLAP Visualization and Analysis Tool (SOVAT). J Usability Stud [Internet]. 2007;2:76–95. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=pmnm2&NEWS=N&AN=26613012
Harris JK, Hinyard L, Beatty K, Hawkins JB, Brownstein JS, Nsoesie EO, et al. Evaluating the implementation of a twitter-based foodborne illness reporting tool in the city of St. Louis department of health. Int J Environ Res Public Health. 2018;15:833.
pubmed: 29695038
pmcid: 5981872
doi: 10.3390/ijerph15050833
McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS peer review of electronic search strategies: 2015 guideline statement. J Clin Epidemiol. 2016;75:40–6.
pubmed: 27005575
doi: 10.1016/j.jclinepi.2016.01.021
Leape LL. Human factors meets health care: the ultimate challenge. Ergon Des. 2004;12:6–12.
Cafazzo JA, St-Cyr O. From discovery to design: the evolution of human factors in healthcare. Healthc Q. 2012;15:24–9.
pubmed: 22874443
doi: 10.12927/hcq.2012.22845
Veritas Health Innovation. Covidence systematic review software. Veritas Health Innovation.
Accorsi P, Lalande N, Fabrègue M, Braud A, Poncelet P, Sallaberry A et al. HydroQual: Visual analysis of river water quality. 2014 IEEE Conference on Visual Analytics Science and Technology (VAST). IEEE; 2014. pp. 123–32.
Adini B, Verbeek L, Trapp S, Schilling S, Sasse J, Pientka K et al. Continued vigilance - development of an online evaluation tool for assessing preparedness of medical facilities for biological events. Front Public Health [Internet]. 2014;2:35. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=pmnm3&NEWS=N&AN=24783192
Al-Hajj S, Fisher B, Smith J, Pike I. Collaborative visual analytics: a health analytics approach to injury prevention. Int J Environ Res Public Health. 2017;14.
Ali H, Waruru A, Zielinski-Gutierrez E, Kim AA, Swaminathan M, De Cock KM, et al. Evaluation of an HIV-Related Mortuary Surveillance System - Nairobi, Kenya, two sites, 2015. MMWR Surveill Summ. 2018;67:1–12.
pubmed: 30574955
pmcid: 6309216
doi: 10.15585/mmwr.ss6714a1.
Anderson B, Coulter S, Orlowsky R, Ruzich B, Smedley R, Purvis M et al. Designing user experiences for policymakers in serious games in the domain of global food security. University of Virginia, Charlottesville, VA, United States BT – 2017 Systems and Information Engineering Design Symposium (SIEDS), 28 April 2017: IEEE; 2017. pp. 89–94.
Andersson SR, Hassanen S, Momanyi AM, Onyango DK, Lutukai MN, Chandani YK, et al. Using human-centered design to Adapt Supply chains and Digital Solutions for Community Health Volunteers in nomadic communities of Northern Kenya. Glob Health Sci Pract. 2021;9:S151–67.
pubmed: 33727327
pmcid: 7971376
doi: 10.9745/GHSP-D-20-00378
Anema A, Druyts E, Hollmeyer HG, Hardiman MC, Wilson K. Descriptive review and evaluation of the functioning of the International Health regulations (IHR) annex 2. Global Health. 2012;8:1.
pubmed: 22233652
pmcid: 3313850
doi: 10.1186/1744-8603-8-1
Azofeifa A, Yeung LF, Duke CW, Gilboa SM, Correa A. Evaluation of an active surveillance system for stillbirths in metropolitan Atlanta. J Registry Manag. 2012;39:13–36.
pubmed: 23270086
Bhowmick T, Robinson AC, Gruver A, MacEachren AM, Lengerich EJ. Distributed usability evaluation of the Pennsylvania Cancer Atlas. Int J Health Geogr. 2008;7:36.
pubmed: 18620565
pmcid: 2490686
doi: 10.1186/1476-072X-7-36
Bollaerts K, De Smedt T, Donegan K, Titievsky L, Bauchau Kaatje. ORCID: http://orcid.org/0000-0001-7704-0527 VAO-B. Benefit-Risk monitoring of vaccines using an interactive dashboard: a methodological proposal from the ADVANCE Project. Drug Saf. 2018;41:775–86.
pubmed: 29582392
pmcid: 6061437
doi: 10.1007/s40264-018-0658-y
Boonchieng W, Tuanrat W, Aungwattana S, Tamdee D, Budda D. Development of a Community-based Geographic Health Information System via Mobile Phone in Saraphi District. J Computers (Taiwan). 2019;30:84–92.
Borges HL, Malucelli A, Paraiso EC, Moro CC. A physiotherapy EHR specification based on a user-centered approach in the context of public health. AMIA. Annual Symposium proceedings / AMIA Symposium AMIA Symposium. 2007;61–5.
Brownson RC, Kemner AL, Brennan LK. Applying a mixed-methods evaluation to healthy kids, Healthy communities. J Public Health Manag Pract. 2015;21:S16–26.
pubmed: 25828217
pmcid: 4746076
doi: 10.1097/PHH.0000000000000233
Butchart A, Peden M, Matzopoulos R, Phillips R, Burrows S, Bhagwandin N, et al. The South African National Non-natural Mortality Surveillance System–rationale, pilot results and evaluation. S Afr Med J. 2001;91:408–17.
pubmed: 11455806
Carr ECJ, Babione JN, Marshall D. Translating research into practice through user-centered design: an application for osteoarthritis healthcare planning. Int J Med Inf. 2017;104:31–7.
doi: 10.1016/j.ijmedinf.2017.05.007
Cesario M, Jervis M, Luz S, Masoodian M, Rogers B. Time-based geographical mapping of communicable diseases BT – 2012 16th International Conference on Information Visualisation, IV. 2012, July 11, 2012 - July 13, 2012. Graduate Programme on Health Promotion, University of Franca, BrazilDepartment of Computer Science, University of Waikato, New ZealandSchool of Computer Science and Statistics, Trinity College Dublin, Ireland: Institute of Electrical and Electronics Engineers Inc.; 2012. pp. 118–23.
Chirambo GB, Muula AS, Thompson M, Hardy VE, Heavin C, Connor YO et al. End-user perspectives of two mHealth decision support tools: Electronic Community Case Management in Northern Malawi. Int J Med Inf. 2021;145.
Cinnamon J, Rinner C, Cusimano MD, Marshall S, Bakele T, Hernandez T, et al. Evaluating web-based static, animated and interactive maps for injury prevention. Geospat Health. 2009;4:3–16.
pubmed: 19908186
doi: 10.4081/gh.2009.206
Cleland B, Wallace J, Bond R, Muuraiskangas S, Pajula J, Epelde G et al. July. Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. Ulster University, School of Computing, United Kingdom BT - Human Interface and the Management of Information. HIMI 2019, held as part of the 21st HCI International Conference, HCII 2019, 26–31 2019: Springer International Publishing; 2019. pp. 194–207. https://doi.org/10.1007/978-3-030-22660-2_13
Concannon D, Herbst K, Manley E. Developing a data dashboard framework for population health surveillance: Widening access to clinical trial findings. JMIR Form Res [Internet]. 2019;3. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85096868744&doi=10.2196%2F11342&partnerID=40&md5=0596 d9738c51cdb49ebf2e5f2a2d010f.
Cox R, Sanchez J, Revie CW. Multi-criteria Decision Analysis Tools for prioritising emerging or re-emerging infectious diseases Associated with Climate Change in Canada. PLoS ONE. 2013;8:e68338.
pubmed: 23950868
pmcid: 3737372
doi: 10.1371/journal.pone.0068338
Cretikos M, Telfer B, McAnulty J. Evaluation of the system of surveillance for enteric disease outbreaks, New South Wales, Australia, 2000 to 2005. N S W Public Health Bull. 2008;19:8–14.
pubmed: 18361862
doi: 10.1071/NB07079
Cruden G, Frerichs L, Powell BJ, Lanier P, Brown CH, Lich Gracelyn. ORCID: http://orcid.org/0000-0002-1737-5867 KHAI-O http://orcid.org/Cruden. Developing a multi-criteria decision analysis tool to support the adoption of evidence-based child maltreatment prevention programs. Aarons Baumann, Belton, Bonabeau, Buffett, Cruden, Glasgow, Marsh, Muhlbacher, Palinkas, Sheldrick, Stoltzfus, Thokala, Tversky A, editor. Prev Sci. 2020;No-Specified.
Cunningham PM, Cunningham M, van Greunen D, Veldsman A, Kanjo C, Kweyu E et al. Oct. Implications of baseline study findings from rural and deep rural clinics in Ethiopia, Kenya, Malawi and South Africa for the co-design of mHealth4Afrika. Stockholm University, Dept. of Computer and Systems Sciences, 13 Docklands Innovation Park, 128 East Wall Road, Ireland BT – 2016 IEEE Global Humanitarian Technology Conference (GHTC), 13–16 2016: IEEE; 2016. pp. 666–74.
Dalle Carbonare S, Cerra C, Bellazzi R. Development and representation of health indicators with thematic maps. Stud Health Technol Inform [Internet]. 2012;180:220–4. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emed13&NEWS=N&AN=366370560
Fico G, Hernanzez L, Cancela J, Arredondo MT, Dagliati A, Sacchi L, et al. What do healthcare professionals need to turn risk models for type 2 diabetes into usable computerized clinical decision support systems? Lessons learned from the MOSAIC project. BMC Med Inf Decis Mak. 2019;19:163.
doi: 10.1186/s12911-019-0887-8
Finch CF, Goode N, Salmon PM, Shaw Caroline F. ORCID: http://orcid.org/0000-0003-1711-1930 LAO-F. End-user experiences with two incident and injury reporting systems designed for led outdoor activities - challenges for implementation of future data systems. Inj Epidemiol. 2019;6:39.
pubmed: 31516813
pmcid: 6732829
doi: 10.1186/s40621-019-0214-y
Fisher RP, Myers BA. Free and simple GIS as appropriate for health mapping in a low resource setting: a case study in eastern Indonesia. Int J Health Geogr. 2011;10:15.
pubmed: 21352553
pmcid: 3051879
doi: 10.1186/1476-072X-10-15
Foldy SL, Barthell E, Silva J, Biedrzycki P, Howe D, Erme M, et al. SARS Surveillance project–internet-enabled multiregion surveillance for rapidly emerging disease. MMWR Morb Mortal Wkly Rep. 2004;53:215–20.
Foldy SL, Biedrzycki PA, Baker BK, Swain GR, Howe DS, Gieryn D, et al. The public health dashboard: a surveillance model for bioterrorism preparedness. J Public Health Manag Pract. 2004;10:234–40.
pubmed: 15253519
doi: 10.1097/00124784-200405000-00007
Gagnon M-P, Lampron A, Buyl R, Implementation. and adoption of an electronic information system for vaccine inventory management BT – 49th Annual Hawaii International Conference on System Sciences, HICSS 2016, January 5, 2016 - January 8, 2016. Universite Laval, CanadaCHU de Quebec Research Center, CanadaVrije Universiteit, Brussel, Belgium: IEEE Computer Society; 2016. pp. 3172–8.
Gerrits RG, Klazinga NS, van den Berg MJ, Kringos Reinie G. ORCID: http://orcid.org/0000-0001-8030-2882 DSAO-G. figure interpretation Assessment Tool-Health (FIAT-health) 2.0: from a scoring instrument to a critical appraisal tool. BMC Med Res Methodol. 2019;19:160.
pubmed: 31337354
pmcid: 6647325
doi: 10.1186/s12874-019-0797-6
Gesteland PH, Livnat Y, Galli N, Samore MH, Gundlapalli AV. The EpiCanvas infectious disease weather map: an interactive visual exploration of temporal and spatial correlations. J Am Med Inform Assoc. 2012;19:954–9.
pubmed: 22358039
pmcid: 3534447
doi: 10.1136/amiajnl-2011-000486
Gourevitch MN, Athens JK, Levine SE, Kleiman N, Thorpe LE. City-Level Measures of Health, Health determinants, and equity to Foster Population Health Improvement: the City Health Dashboard. Am J Public Health. 2019;109:585–92.
pubmed: 30789770
pmcid: 6417588
doi: 10.2105/AJPH.2018.304903
Grossberndt S, Bartonova A, Van Den Hazel P. Application of social media in the environment and health professional community. Environ Health. 2012;11:S16.
pubmed: 22759498
pmcid: 3388439
doi: 10.1186/1476-069X-11-S1-S16
Guthrie JL, Marchand-Austin A, Lam K, Whelan M, Lee B, Alexander DC, et al. Technology and tuberculosis control: the OUT-TB web experience. J Am Med Inform Assoc. 2017;24:e136–42.
pubmed: 27589943
doi: 10.1093/jamia/ocw130
Hawver JE, Rocheleau B, Wyllie TT, Waller KN, Bailey R, Smith MC. Mental health resources and the criminal justice system: Assessment and plan for integration in Charlottesville, Virginia - Phase III expansion BT – 2009 IEEE Systems and Information Engineering Design Symposium, SIEDS ’09, April 24, 2009 - April 24, 2. University of Virginia, Charlottesville, VA 22904, United StatesDepartment of Systems and Information Engineering, University of Virginia, Charlottesville, VA 22904, United States: IEEE Computer Society; 2009. pp. 197–202. https://doi.org/10.1109/SIEDS.2009.5166183
Ha YP, Tesfalul MA, Littman-Quinn R, Antwi C, Green RS, Mapila TO et al. Becerra Chapman Creswell Daemen Denkinger Fox Ha Karlesky Kayiwa Khan Labrique Lewis Puryear Timimi B Vella editor 2016 Evaluation of a mobile health approach to Tuberculosis contact tracing in Botswana. J Health Commun 21 1115–21.
pubmed: 27668973
pmcid: 6238947
doi: 10.1080/10810730.2016.1222035
Heidebrecht CL, Wells GA, Tugwell PS, Engel ME. Tuberculosis surveillance in Cape Town, South Africa: an evaluation. Int J Tuberculosis Lung Disease. 2011;15:912–8.
doi: 10.5588/ijtld.10.0296
Hundley VA, Avan BI, Ahmed H, Graham WJ, Group BKW. Clean birth kits to improve birth practices: development and testing of a country level decision support tool. BMC Pregnancy Childbirth. 2012;12:158.
pubmed: 23253170
pmcid: 3541163
doi: 10.1186/1471-2393-12-158
Hu PJ, Zeng D, Chen H, Larson C, Chang W, Tseng C et al. System for infectious disease information sharing and analysis: design and evaluation. IEEE Trans Inf Technol Biomed [Internet]. 2007;11:483–92. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emed10&NEWS=N&AN=47306402
Hussain-Alkhateeb L, Olliaro P, Benitez D, Kroeger A, Sewe MO, Rocklov J, et al. Early warning and response system (EWARS) for dengue outbreaks: recent advancements towards widespread applications in critical settings. PLoS ONE. 2018;13:e0196811.
pubmed: 29727447
pmcid: 5935393
doi: 10.1371/journal.pone.0196811
Ilesanmi OS, Fawole O, Nguku P, Oladimeji A, Nwenyi O. Evaluation of Ebola virus disease surveillance system in Tonkolili District, Sierra Leone. Pan Afr Med J. 2019;32:2.
pubmed: 30984324
pmcid: 6445398
doi: 10.11604/pamj.supp.2019.32.1.14434
Jaroensutasinee M, Jaroensutasinee K, Jinpon P. Integrated information visualization to support decision-making in order to strengthen communities: design and usability evaluation. Inf Health Soc Care. 2017;42:335–48.
doi: 10.1080/17538157.2016.1255626
Joshi A, de Araujo Novaes M, Machiavelli J, Iyengar S, Vogler R, Johnson C, et al. A human centered GeoVisualization framework to facilitate visual exploration of telehealth data: a case study. Technol Health Care. 2012;20:457–71.
pubmed: 23187012
Joyce K. To me it’s just another tool to help understand the evidence: public health decision-makers’ perceptions of the value of geographical information systems (GIS). Health Place. 2009;15:801–10.
pubmed: 19268622
doi: 10.1016/j.healthplace.2009.01.004
Kadam R, White W, Banks N, Katz Z, Kelly-Cirino C, Dittrich S. Target product profile for a mobile app to read rapid diagnostic tests to strengthen infectious disease surveillance. PLoS ONE. 2020;15:e0228311.
pubmed: 31995628
pmcid: 6988927
doi: 10.1371/journal.pone.0228311
Karavite DJ, Miller MW, Ramos MJ, Rettig SL, Ross RK, Xiao R, et al. User testing an information foraging Tool for Ambulatory Surgical site infection surveillance. Appl Clin Inf. 2018;9:791–802.
doi: 10.1055/s-0038-1675179
Kealey CM, Brunetti GM, Valaitis RK, Akhtar-Danesh N, Thomas H. A severe Acute Respiratory Syndrome extranet: supporting local communication and information dissemination. BMC Med Inf Decis Mak. 2005;5:17.
doi: 10.1186/1472-6947-5-17
Keeling JW, Turner AM, Allen EE, Rowe SA, Merrill JA, Liddy ED et al. Development and evaluation of a prototype search engine to meet public health information needs. AMIA. Annual Symposium proceedings / AMIA Symposium AMIA Symposium. 2011;2011:693–700.
Kelly GC. A spatial decision support system for guiding focal indoor residual spraying interventions in a malaria elimination zone. Geospat Health. 2011;6:21–31.
pubmed: 22109860
doi: 10.4081/gh.2011.154
Laberge M, Shachak A. Developing a tool to assess the quality of socio-demographic data in community health centres. Appl Clin Inf. 2013;4:1–11.
doi: 10.4338/ACI-2012-10-CR-0041
Liaw S-T, Ansari S, Zhou R, Gao J. A digital health profile & maturity assessment toolkit: cocreation and testing in the Pacific Islands. J Am Med Inf Assoc. 2021;28:494–503.
doi: 10.1093/jamia/ocaa255
Livnat Y, Rhyne T-M, Samore MH. Epinome: a visual-analytics workbench for epidemiology data. IEEE Comput Graph Appl. 2012;32:89–95.
pubmed: 24804950
doi: 10.1109/MCG.2012.31
Loschen W, Coberly J, Sniegoski C, Holtry R, Sikes M, Happel Lewis S. Event communication in a regional disease surveillance system. AMIA. Annual Symposium proceedings / AMIA Symposium AMIA Symposium. 2007;483–7.
Loschen W, Seagraves R, Holtry R, Hung L, Lombardo J, Lewis S. INFOSHARE - an Information Sharing Tool for Public Health during the 2009 presidential inauguration and H1N1 outbreak. Online J Public Health Inf. 2010;2.
Maclachlan JC, Jerrett M, Abernathy T, Sears M, Bunch MJ. Mapping health on the internet: a new tool for environmental justice and public health research. Health Place. 2007;13:72–86.
pubmed: 16527510
doi: 10.1016/j.healthplace.2005.09.012
Mansoor H, Gerych W, Alajaji A, Buquicchio L, Chandrasekaran K, Agu E, PLEADES: Population level observation of smartphone sensed symptoms for in-the-wild data using clustering BT – 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics, Theory, Applications VISIGRAPP et al. 2021, February 8, 2021. Department of Data Science, Worcester Polytechnic Institute, Worcester; MA, United StatesDepartment of Computer Science, Worcester Polytechnic Institute, Worcester; MA, United States: SciTePress; 2021. pp. 64–75.
Margevicius KJ, Generous N, Abeyta E, Castro L, Daughton A, Del Valle SY, et al. The biosurveillance analytics resource directory (BARD): facilitating the use of epidemiological models for infectious disease surveillance. PLoS ONE. 2016;11:e0146600.
pubmed: 26820405
pmcid: 4731202
doi: 10.1371/journal.pone.0146600
Bögl M, Aigner W, Filzmoser P, Lammarsch T, Miksch S, Rind A. Visual analytics for Model Selection in Time Series Analysis. IEEE Trans Vis Comput Graph. 2013;19:2237–46.
pubmed: 24051790
doi: 10.1109/TVCG.2013.222
Merkord CL, Liu Y, Mihretie A, Gebrehiwot T, Awoke W, Bayabil E et al. Integrating malaria surveillance with climate data for outbreak detection and forecasting: the EPIDEMIA system. Malar J. 2017;16.
Millery M, Ramos W, Lien C, Kukafka R, Aguirre AN. Design of a Community-Engaged Health Informatics Platform with an Architecture of Participation. AMIA Annu Symp Proc. 2015;2015:905–14.
Mukhtar Q, Mehta P, Brody ER, Camponeschi J, Friedrichs M, Kemple AM, et al. Development of the diabetes indicators and data sources Internet Tool (DIDIT). Prev Chronic Dis. 2006;3:A20.
pubmed: 16356373
Nagykaldi Z, Mold JW, Bradley KK, Bos JE. Bridging the gap between public and private healthcare: influenza-like illness surveillance in a practice-based research network. J Public Health Manag Pract. 2006;12:356–64.
pubmed: 16775533
doi: 10.1097/00124784-200607000-00009
Ngo TD, Canavati SE, Dinh HS, Ngo TD, Tran DT, Martin NJ et al. Addressing operational challenges of combatting malaria in a remote forest area of Vietnam using spatial decision support system approaches. Geospat Health. 2019;14.
Nguyen LH, LeFevre AE, Jennings L, Agarwal S, Labrique AB, Mehl G, et al. Perceptions of data processes in mobile-based versus paper-based health information systems for maternal, newborn and child health: a qualitative study in Andhra Pradesh, India. BMJ Innov. 2015;1:167–73.
doi: 10.1136/bmjinnov-2015-000063
Olingson C, Hallberg N, Timpka T, Lindqvist K. Requirements engineering for inter-organizational health information systems with functions for spatial analyses: modeling a WHO safe community applying use case maps. Methods Inf Med. 2002;41:299–304.
Chen M, Trefethen A, Bañares-Alcántara R, Jirotka M, Coecke B, Ertl T, et al. From data analysis and visualization to causality discovery. Comput (Long Beach Calif). 2011;44:84–7.
Park S, Gil-Garcia JR. Understanding transparency and accountability in open government ecosystems: The case of health data visualizations in a state government BT – 18th Annual International Conference on Digital Government Research, DG.O. 2017, June 7, 2017 - June 9, 2017. University at Albany, State University of New York, 187 Wolf Road, Suite 301, Albany; NY; 12205, United States: Association for Computing Machinery; 2017. pp. 39–47.
Patel R, Ahn E, Baldacchino T, Mullavey T, Kim J, Liu N et al. A Mobile App and Dashboard for Early Detection of Infectious Disease Outbreaks: Development Study. JMIR Public Health Surveill [Internet]. 2021;7:e14837. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emexb&NEWS=N&AN=634537554
Pelat C, Bonmarin I, Ruello M, Fouillet A, Caserio-Schonemann C, Levy-Bruhl D et al. Improving regional influenza surveillance through a combination of automated outbreak detection methods: the 2015/16 season in France. Eurosurveillance. 2017;22.
Rachmani E, Lin M-C, Hsu CY, Jumanto J, Iqbal U, Shidik GF et al. The implementation of an integrated e-leprosy framework in a leprosy control program at primary health care centers in Indonesia. Int J Med Inf. 2020;140.
Rajamani S, Bieringer A, Sowunmi S, Muscoplat M. Stakeholder Use and Feedback on Vaccination History and Clinical Decision Support for Immunizations Offered by Public Health. AMIA Annu Symp Proc. 2017;2017:1450–7.
Rajvanshi H, Telasey V, Soni C, Jain D, Surve M, Gangamwar V, et al. A comprehensive mobile application tool for disease surveillance, workforce management and supply chain management for Malaria Elimination Demonstration Project. Malar J. 2021;20:91.
pubmed: 33593359
pmcid: 7885520
doi: 10.1186/s12936-021-03623-3
Reeder B, Hills RA, Turner AM, Demiris G. Participatory design of an integrated information system design to support public health nurses and nurse managers. Public Health Nurs. 2014;31:183–92.
pubmed: 24117760
doi: 10.1111/phn.12081
Reeder B, Turner AM. Scenario-based design: a method for connecting information system design with public health operations and emergency management. J Biomed Inf. 2011;44:978–88.
doi: 10.1016/j.jbi.2011.07.004
Rezaei-hachesu P, Samad-Soltani T, Yaghoubi S, GhaziSaeedi M, Mirnia K, Masoumi-Asl H, et al. The design and evaluation of an antimicrobial resistance surveillance system for neonatal intensive care units in Iran. Int J Med Inf. 2018;115:24–34.
doi: 10.1016/j.ijmedinf.2018.04.007
Roberton T, Litvin K, Self A, Stegmuller AR. All things to all people: trade-offs in pursuit of an ideal modeling tool for maternal and child health. BMC Public Health. 2017;17:785.
pubmed: 29143679
pmcid: 5688440
doi: 10.1186/s12889-017-4751-4
Robinson AC, MacEachren AM, Roth RE. Designing a web-based learning portal for geographic visualization and analysis in public health. Health Inf J. 2011;17:191–208.
doi: 10.1177/1460458211409718
Sahar L, Faler G, Hristov E, Hughes S, Lee L, Westnedge C, et al. Development of the Inventory Management and Tracking System (IMATS) to Track the Availability of Public Health Department Medical Countermeasures during Public Health Emergencies. Online J Public Health Inf. 2015;7:e212.
Semwanga AR, Nakubulwa S, Adam T. Applying a system dynamics modelling approach to explore policy options for improving neonatal health in Uganda. Health Res Policy Syst. 2016;14:35.
pubmed: 27146327
pmcid: 4855338
doi: 10.1186/s12961-016-0101-8
Sopan A, Noh ASI, Karol S, Rosenfeld P, Lee G, Shneiderman B. Community Health Map: a geospatial and multivariate data visualization tool for public health datasets. Gov Inf Q. 2012;29:223–34.
doi: 10.1016/j.giq.2011.10.002
Sorge J, Klassen B, Higgins R, Tooley L, Ablona A, Jollimore J, et al. Democratizing Access to Community-based survey findings through dynamic data visualizations. Arch Sex Behav. 2021;50:119–28.
pubmed: 32909142
doi: 10.1007/s10508-020-01806-8
Stegmuller AR, Self A, Litvin K, Roberton T. How is the lives Saved Tool (LiST) used in the global health community? Results of a mixed-methods LiST user study. BMC Public Health. 2017;17:773.
pubmed: 29143640
pmcid: 5688436
doi: 10.1186/s12889-017-4750-5
Struik LL, Abramowicz A, Riley B, Oliffe JL, Bottorff JL, Stockton Laura L. ORCID: http://orcid.org/0000-0001-7175-7308, Bottorff, Joan L.; ORCID: http://orcid.org/0000-0001-9724-5351 LDAI-O http://orcid.org/Struik. Evaluating a tool to support the integration of gender in programs to promote men’s health. Affleck Bottorff, Bunn, Damschroder, Dworkin, Gahagan, Galdas, Gelb, Heidari, Heilman, Kiselica, Langley, Lefkowich, Mackenzie, McIntosh, Ogrodniczuk, Oliffe, Oliffe, Oliffe, Paretz, Pirkis, Robertson, Robertson, Robertson, Robertson, Rycroft-Malone, San B, editor. Am J Mens Health. 2019;13.
Studnicki J, Fisher JW, Eichelberger C, Bridger C, Angelon-Gaetz K, Nelson D. NC CATCH: Advancing Public Health Analytics. Online J Public Health Inf. 2010;2.
Sutcliffe A, De Bruijn O, Thew S, Buchan I, Jarvis P, McNaught J, et al. Developing visualization-based decision support tools for epidemiology. Inf Vis. 2014;13:3–17.
doi: 10.1177/1473871612445832
Svoronos T, Jillson IA, Nsabimana MM. TRACnet’s absorption into the Rwandan HIV/AIDS response. Int J Healthc Technol Manage. 2008;9:430–45.
doi: 10.1504/IJHTM.2008.020197
Swoboda CM, Griesenbrock T, Gureddygari HR, Aldrich A, Fareed N, Jonnalagadda P. Visualizing Opportunity Index Data Using a Dashboard Application: A Tool to Communicate Infant Mortality-Based Area Deprivation Index Information. Appl Clin Inform [Internet]. 2020;11:515–27. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emexa&NEWS=N&AN=632546907
Thew SL, Sutcliffe A, de Bruijn O, McNaught J, Procter R, Jarvis P, et al. Supporting creativity and appreciation of uncertainty in exploring geo-coded public health data. Methods Inf Med. 2011;50:158–65.
pubmed: 20686732
doi: 10.3414/ME09-01-0070
Tilahun B, Kauppinen T, Kesler C, Fritz F. Design and development of a linked open data-based health information representation and visualization system: potentials and preliminary evaluation. JMIR Med Inf. 2014;2:e31.
doi: 10.2196/medinform.3531
Tobgay T, Samdrup P, Jamtsho T, Mannion K, Thriemer K, Ortega L, et al. Performance and user acceptance of the Bhutan febrile and malaria information system: report from a pilot study. Malar J. 2016;15:52.
pubmed: 26822591
pmcid: 4731940
doi: 10.1186/s12936-016-1105-0
Tom-Aba D, Toikkanen SE, Glockner S, Denecke K, Silenou BC, Krause G et al. User Evaluation Indicates High Quality of the Surveillance Outbreak Response Management and Analysis System (SORMAS) After Field Deployment in Nigeria in 2015 and 2018. Stud Health Technol Inform [Internet]. 2018;253:233–7. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emed19&NEWS=N&AN=624845037
Travers D, Crouch J, Haas SW, Mostafa J, Waller AE, Schwartz TA et al. Implementation of Emergency Medical Text Classifier for syndromic surveillance. AMIA. Annual Symposium proceedings / AMIA Symposium AMIA Symposium. 2013;2013:1365–74.
Turner AM, Reeder B, Wallace JC. A resource management tool for public health continuity of operations during disasters. Disaster Med Public Health Prep. 2013;7:146–52.
pubmed: 24618165
pmcid: 4062076
doi: 10.1017/dmp.2013.24
Velicko I, Riera-Montes M. The Chlamydia surveillance system in Sweden delivers relevant and accurate data: results from the system evaluation, 1997–2008. Eurosurveillance. 2011;16.
Wang E-H, Zhou L, Watzlaf V, Abernathy PA, Web-Based Social Network Analysis System for Guiding Behavioral Interventions Delivery in Medically Underserved Communities BT – 2017 International Conference on Computational Science and, Intelligence C. CSCI 2017, December 14, 2017 - Dec. FPFHC, FOCUS Pittsburgh, Pittsburgh; PA, United StatesDepartment of HIM, University of Pittsburgh, Pittsburgh; PA, United States: Institute of Electrical and Electronics Engineers Inc.; 2017. pp. 840–5.
Wang KH, Marenco L, Madera JE, Aminawung JA, Wang EA, Cheung K-H. Using a community-engaged health informatics approach to develop a web analytics research platform for sharing data with community stakeholders. AMIA Annu Symp Proc. 2017;2017:1715–23.
Wongsapai M, Suebnukarn S, Rajchagool S, Kijsanayotin B. Health-oriented electronic oral health record for health surveillance. Stud Health Technol Inform [Internet]. 2013;192:763–7. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emed14&NEWS=N&AN=603583684
Wu E, Davis A, Villani J, Fareed N, Huerta TR, Harris DR, et al. Community dashboards to support data-informed decision-making in the HEALing communities study. Drug Alcohol Depend. 2020;217:108331.
pubmed: 33070058
pmcid: 7528750
doi: 10.1016/j.drugalcdep.2020.108331
Cole BL, Yancey AK, McCarthy WJ. A graphical, computer-based decision-support tool to help decision makers evaluate policy options relating to physical activity. Am J Prev Med. 2010;39:273–9.
pubmed: 20709260
doi: 10.1016/j.amepre.2010.05.013
Yang J-A, Block J, Jankowska MM, Baer RJ, Chambers CD, Jelliffe-Pawlowski LL, et al. An Online Geographic Data Visualization Tool to relate Preterm births to Environmental factors. Prev Chronic Dis. 2019;16:E102.
pubmed: 31400100
pmcid: 6716387
Kenealy T, et al. A whole of system approach to compare options for CVD interventions in Counties Manukau. Aust N Z J Public Health. 2012;36:263–8.
pubmed: 22672033
doi: 10.1111/j.1753-6405.2011.00812.x
Geyer NR, Kessler FC, Lengerich EJ, United States. LionVu 2.0 usability assessment for Pennsylvania,. ISPRS Int J Geoinf [Internet]. 2020;9. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85094968202&doi=10.3390%2Fijgi9110619&partnerID=40&md5=bbbc5fe3300e82f8555c82bfcd150bec
Jinpon P, Jaroensutasinee M, Jaroensutasinee K. Integrated information visualization to support decision making for health promotion in Chonburi, Thailand. Walailak J Sci Technol. 2019;16:551–60.
doi: 10.48048/wjst.2019.2181
Karlsson D, Ekberg J, Spreco A, Eriksson H, Timpka T. Visualization of infectious disease outbreaks in routine practice. Stud Health Technol Inf. 2013. pp. 697–701.
McGladrey M, Noar S, Crosby R, Young A, Webb E. Creating project CREATE: lessons learned and best practices for developing web-based resources for public health practitioners. Am J Health Educ. 2012;43:341–8.
doi: 10.1080/19325037.2012.10598864
Mittelstädt S, Hao MC, Dayal U, Hsu M-C, Terdiman J, Keim DA. Advanced visual analytics interfaces for adverse drug event detection. Proceedings of the Workshop on Advanced Visual Interfaces AVI. 2014. pp. 237–44.
Osborn AW, Peters LR. Vaccination Data when the outbreak happens: a qualitative evaluation of Oregon’s Rapid Response Tool. Disaster Med Public Health Prep. 2019;13:682–5.
pubmed: 30602401
doi: 10.1017/dmp.2018.130
Parks AL, Walker B, Pettey W, Benuzillo J, Gesteland P, Grant J et al. Interactive agent based modeling of public health decision-making. AMIA. Annual Symposium proceedings / AMIA Symposium AMIA Symposium [Internet]. 2009;2009:504–8. https://www.scopus.com/inward/record.uri?eid=2-s2.0-79953795548&partnerID=40&md5=253273e41c383b4ef358fa638b39a708
Pontin D, Thomas M, Jones G, O’Kane J, Wilson L, Dale F, et al. Developing a family resilience assessment tool for health visiting/public health nursing practice using virtual commissioning, high-fidelity simulation and focus groups. J Child Health Care. 2020;24:195–206.
pubmed: 31340661
doi: 10.1177/1367493519864743
Schooley B, Feldman S, Tipper B. A Unified Framework for Human Centered Design of a Substance Use, Abuse, and Recovery Support System. Advances in Intelligent Systems and Computing. Health Information Technology Program, College of Engineering and Computing, University of South Carolina, 550 Assembly Street, Columbia, SC 29208, United States; 2020. pp. 175–82.
Sinclair S, Hagen NA, Chambers C, Manns B, Simon A, Browman GP. Accounting for reasonableness: exploring the personal internal framework affecting decisions about cancer drug funding. Health Policy. 2008;86:381–90.
pubmed: 18243395
doi: 10.1016/j.healthpol.2007.12.003
Thew S, Sutcliffe A, Procter R, de Bruijn O, McNaught J, Venters CC, et al. Requirements engineering for E-science: experiences in epidemiology. IEEE Softw. 2009;26:80–7.
doi: 10.1109/MS.2009.19
Timpka T, Morin M, Jenvald J, Eriksson H, Gursky E. Towards a simulation environment for modeling of local influenza outbreaks. AMIA. Annual Symposium proceedings / AMIA Symposium AMIA Symposium. 2005;729–33.
Zakkar M, Sedig K. Interactive visualization of public health indicators to support policymaking: an exploratory study. Online J Public Health Inf. 2017;9.
Aburto NJennings, Rogers L, De-Regil LM, aria, Kuruchittham V, Rob G, Arif R et al. An evaluation of a global vitamin and mineral nutrition surveillance system. Arch Latinoam Nutr [Internet]. 2013;63:105–13. http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=emed14&NEWS=N&AN=604450009
Rajamani S, Chakoian H, Bieringer A, Lintelmann A, Sanders J, Ostadkar R, et al. Development and implementation of an interoperability tool across state public health agency’s disease surveillance and immunization information systems. JAMIA Open. 2023;6:ooad055.
pubmed: 37545982
pmcid: 10400481
doi: 10.1093/jamiaopen/ooad055
Akre S, Liu PY, Friedman JR, Bui AAT, International. COVID-19 mortality forecast visualization: Covidcompare.io. JAMIA Open [Internet]. 2021;4. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85140846026&doi=10.1093%2fjamiaopen%2fooab113&partnerID=40&md5=9fc1e6ff64aafb515889c20b67f06e44
Alminana A, Bayeh A, Girma D, Kanagat N, Oot L, Prosser W et al. Early lessons from Ethiopia in establishing a data triangulation process to analyze immunization program and Supply data for decision making. Glob Health Sci Pract. 2022;10.
Alpers R, Kuhne L, Truong H-P, Zeeb H, Westphal M, Jackle S. Evaluation of the EsteR Toolkit for COVID-19 decision support: sensitivity analysis and usability study. JMIR Form Res. 2023;7:e44549.
pubmed: 37368487
pmcid: 10337391
doi: 10.2196/44549
Altura KAP, Madjalis HEC, Sungahid MDG, Serrano EA, Rodriguez RL. Development of a Web-Portal Health Information System for Barangay. Fujisawa, Japan: Institute of Electrical and Electronics Engineers Inc.; 2023. pp. 544–50.
Ansari B, Martin EG. Integrating human-centered design in public health data dashboards: lessons from the development of a data dashboard of sexually transmitted infections in New York State. J Am Med Inf Assoc. 2023.
Backonja U, Park S, Kurre A, Yudelman H, Heindel S, Schultz M et al. Supporting rural public health practice to address local-level social determinants of health across Northwest states: Development of an interactive visualization dashboard. J Biomed Inform [Internet]. 2022;129. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85127144845&doi=10.1016%2fj.jbi.2022.104051&partnerID=40&md5=07f1b9bec7b466f6d0ff6bbe52f77c93
Burgess H, Gutierrez-Mock L, Moghadassi Y-XH, Lesh M, Krueger N et al. E,. Implementing a digital system for contact tracing and case investigation during COVID-19 pandemic in San Francisco: A qualitative study. JAMIA Open [Internet]. 2021;4:ooab093-. https://academic.oup.com/jamiaopen
Delcher C, Horne N, McDonnell C, Bae J, Surratt H. Overdose Detection Mapping Application Program expansion evaluation—A qualitative study. Criminol Public Policy [Internet]. 2023;22:491–516. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85159118390&doi=10.1111%2f1745-9133.12628&partnerID=40&md5=7c72655dfe4bc641d9dbf531a8794f8d
Doyle M, Ainsworth P, Boul S, Lee D. Evaluation of a system for Real-Time Surveillance of Suicide in England. Crisis. 2023;44:341–8.
pubmed: 35984087
doi: 10.1027/0227-5910/a000874
Agbemafle EE, Kubio C, Bandoh D, Odikro MA, Azagba CK, Issahaku RG, et al. Evaluation of the malaria surveillance system - Adaklu District, Volta Region, Ghana, 2019. Public Health Pract (Oxf). 2023;6:100414.
pubmed: 37564781
doi: 10.1016/j.puhip.2023.100414
Filos D, Lekka I, Kilintzis V, Stefanopoulos L, Karavidopoulou Y, Maramis C, et al. Exploring associations between Children’s obesogenic behaviors and the local Environment using Big Data: development and evaluation of the obesity Prevention Dashboard. JMIR Mhealth Uhealth. 2021;9:e26290.
pubmed: 34048353
pmcid: 8274675
doi: 10.2196/26290
Guimarães EADA, Morato YC, Carvalho DBF, Oliveira VCD, Pivatti VMS, Cavalcante RB et al. Evaluation of the Usability of the Immunization Information System in Brazil: A Mixed-Method Study. Telemedicine and e-Health [Internet]. 2021;27:551–60. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85105752793&doi=10.1089%2ftmj.2020.0077&partnerID=40&md5=83f9a036c1d51f62785e1a03f461baf5
Hintermeier M, Gold AW, Erdmann S, Perplies C, Bozorgmehr K, Biddle L. From Research into Practice: Converting Epidemiological Data into Relevant Information for Planning of Regional Health Services for Refugees in Germany. Int J Environ Res Public Health [Internet]. 2022;19:8049. https://www.mdpi.com/1660-4601/19/13/8049/pdf?version=1656585138
Hollis S, Stolow J, Rosenthal M, Morreale SE, Moses L. Go.Data as a digital tool for case investigation and contact tracing in the context of COVID-19: a mixed-methods study. BMC Public Health. 2023;23:1717.
pubmed: 37667290
pmcid: 10476402
doi: 10.1186/s12889-023-16120-w
Said SIM, Aminuddin R, Abidin NAZ, Nasir SDNM, Ibrahim AZM. Visualizing COVID-19 Vaccination Rate and Vaccination Centre in Malaysia using DBSCAN Clustering model. 2022 IEEE International Power and Renewable Energy Conference (IPRECON). 2022. pp. 1–6.
Ising A, Waller A, Frerichs L. Evaluation of an Emergency Department Visit Data Mental Health Dashboard. J Public Health Manag Pract. 2023.
Jonnalagadda P, Swoboda C, Singh P, Gureddygari H, Scarborough S, Dunn I, et al. Developing dashboards to address children’s Health disparities in Ohio. Appl Clin Inf. 2022;13:100–12.
doi: 10.1055/s-0041-1741482
Lardi EA, Khader SAKSAAAMAASA. The Rotavirus Surveillance System in Yemen: evaluation study. JMIR Public Health Surveill. 2021;7:e27625.
pubmed: 34100759
pmcid: 8235281
doi: 10.2196/27625
Lechner C, Rumpler M, Dorley MC, Li Y, Ingram A, Fryman H. Developing an Online Dashboard to Visualize Performance Data—Tennessee Newborn Screening Experience. Int J Neonatal Screen [Internet]. 2022;8. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85138468949&doi=10.3390%2fijns8030049&partnerID=40&md5=e3824922762dd77b6b5004fe604b73c7
Li Y, Albarrak AS. An informatics-driven intelligent system to improve healthcare accessibility for vulnerable populations. J Biomed Inform [Internet]. 2022;134. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85137174603&doi=10.1016%2fj.jbi.2022.104196&partnerID=40&md5=d6ea5cf40f3b559a4ca1233bb856ae72
Mansoor H, Gerych W, Alajaji A, Buquicchio L, Chandrasekaran K, Agu E, et al. PLEADES: Population level observation of smartphone sensed symptoms for in-the-wild data using clustering. Virtual, Online: SciTe; 2021. pp. 64–75.
Meidani Z, Moravveji A, Gohari S, Ghaffarian H, Zare S, Vaseghi F, et al. Development and Testing requirements for an Integrated Maternal and Child Health Information System in Iran: A Design thinking Case Study. Methods Inf Med. 2022;61:e64–72.
pubmed: 35609871
pmcid: 9788911
doi: 10.1055/a-1860-8618
O’Flaherty M, Lloyd-Williams F, Capewell S, Boland A, Maden M, Collins B et al. Modelling tool to support decision-making in the NHS Health Check programme: Workshops, systematic review and co-production with users. Health Technol Assess (Rockv) [Internet]. 2021;25:1–233. https://www.journalslibrary.nihr.ac.uk/hta/hta25350/#/abstract
O’Leary MC, Mayorga KHL, Hicklin ME, Davis K, Brenner MM et al. AT,. Engaging stakeholders in the use of an interactive simulation tool to support decision-making about the implementation of colorectal cancer screening interventions. Cancer Causes and Control [Internet]. 2023; https://www.springer.com/journal/10552
Praharaj S, Solis P, Wentz EA. Deploying geospatial visualization dashboards to combat the socioeconomic impacts of COVID-19. Environ Plan B Urban Anal City Sci [Internet]. 2023;50:1262–79. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85148503498&doi=10.1177%2f23998083221142863&partnerID=40&md5=f1c96f0c706aa744fb4a99f1150a1787
Rivers Z, Roth JA, Wright W, Rim SH, Richardson LC, Thomas CC, et al. Translating an Economic Analysis into a Tool for Public Health Resource Allocation in Cancer Survivorship. MDM Policy Pract. 2023;8:23814683231153376.
Swift B, Imohe A, Perez CH, Mwirigi L. An in-depth review of the UNICEF NutriDash platform, lessons learnt and future perspectives: a mixed-methods study. BMJ Open [Internet]. 2023;13:e062684-. http://bmjopen.bmj.com/content/early/by/section
Tchoualeu DD, Elmousaad HE, Osadebe LU, Adegoke OJ, Nnadi C, Haladu SA, et al. Use of a district health information system 2 routine immunization dashboard for immunization program monitoring and decision making, Kano State, Nigeria. Pan Afr Med J. 2021;40:2.
pubmed: 36157564
pmcid: 9474830
Tegegne HA, Bogaardt C, Collineau L, Cazeau G, Lailler R, Reinhardt J et al. OH-EpiCap: A semi-quantitative tool for the evaluation of One Health epidemiological surveillance capacities and capabilities. medRxiv [Internet]. 2023; https://www.medrxiv.org/
Tennant R, Tetui M, Grindrod K, Burns CM. Multi-disciplinary Design and implementation of a Mass Vaccination Clinic Mobile Application to support decision-making. IEEE J Transl Eng Health Med. 2023;11:60–9.
pubmed: 36654771
doi: 10.1109/JTEHM.2022.3224740
Vázquez Noguera JL, Ho Shin H, Sauer Ayala C, Grillo S, Pérez-Estigarribia P, Torales R et al. Epymodel: A User-Friendly Web Application for Visualising COVID-19 Projections for Paraguay Including Under-Reporting and Vaccination. Communications in Computer and Information Science [Internet]. 2023. pp. 58–72. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85169037861&doi=10.1007%2f978-3-031-36357-3_5&partnerID=40&md5=5a6a2c39c2f97a9230239d0b54f42116
Wells J, Grant R, Chang J, Kayyali R. Evaluating the usability and acceptability of a geographical information system (GIS) prototype to visualise socio-economic and public health data. BMC Public Health. 2021;21:2151.
pubmed: 34819037
pmcid: 8611402
doi: 10.1186/s12889-021-12072-1
Zheng S, Edwards JR, Dudeck MA, Patel PR, Wattenmaker L, Mirza M, et al. Building an Interactive Geospatial Visualization Application for National Health Care-Associated Infection Surveillance: Development Study. JMIR Public Health Surveill. 2021;7:e23528.
pubmed: 34328436
pmcid: 8367128
doi: 10.2196/23528
Yang C, Zhang Z, Fan Z, Jiang R, Chen Q, Song X, et al. EpiMob: interactive visual analytics of Citywide Human mobility restrictions for Epidemic Control. IEEE Trans Vis Comput Graph. 2023;29:3586–601.
pubmed: 35385385
doi: 10.1109/TVCG.2022.3165385
Shimpi N, Glurich I, Hegde H, Steinmetz A, Kuester R, Crespin M et al. DentaSeal: a school-based dental sealant efficiency assessment tool to support statewide monitoring and reporting: a field report. Technol Health Care. 2023.
Rabiee F. Focus-group interview and data analysis. Proceedings of the nutrition society. 2004;63:655–60.
Lu S, Christie GA, Nguyen TT, Freeman JD, Hsu EB. Applications of artificial intelligence and machine learning in disasters and public health emergencies. Disaster Med Public Health Prep. 2022;16:1674–81.
pubmed: 34134815
doi: 10.1017/dmp.2021.125
Equator Network. Enhancing the quality and transparency of health research. 2016. https://www.equator-network.org/