Risk heatmaps as visual displays: Opening movie studios after the COVID-19 shutdown.
COVID-19
heatmaps
movie studios
risk communication
risk perception
Journal
Risk analysis : an official publication of the Society for Risk Analysis
ISSN: 1539-6924
Titre abrégé: Risk Anal
Pays: United States
ID NLM: 8109978
Informations de publication
Date de publication:
17 Sep 2022
17 Sep 2022
Historique:
revised:
18
07
2022
received:
01
07
2021
accepted:
05
08
2022
entrez:
17
9
2022
pubmed:
18
9
2022
medline:
18
9
2022
Statut:
aheadofprint
Résumé
Upon shutting down operations in early 2020 due to the COVID-19 pandemic, the movie industry assembled teams of experts to help develop guidelines for returning to operation. It resulted in a joint report, The Safe Way Forward, which was created in consultation with union members and provided the basis for negotiations with the studios. A centerpiece of the report was a set of heatmaps displaying SARS-CoV-2 risks for a shoot, as a function of testing rate, community infection prevalence, community transmission rate (R0), and risk measure (either expected number of cases or probability of at least one case). We develop and demonstrate a methodology for evaluating such complex displays, in terms of how well they inform potential users, in this case, workers deciding whether the risks of a shoot are acceptable. We ask whether individuals making hypothetical return-to-work decisions can (a) read display entries, (b) compare display entries, and (c) make inferences based on display entries. Generally speaking, respondents recruited through the Amazon MTurk platform could interpret the display information accurately and make coherent decisions, suggesting that heatmaps can communicate complex risks to lay audiences. Although these heatmaps were created for practical, rather than theoretical, purposes, these results provide partial support for theoretical accounts of visual information processing and identify challenges in applying them to complex settings.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Subventions
Organisme : Riksbankens Jubileumsfond
Organisme : Carnegie Mellon University Deans Scholarship
Organisme : National Science Foundation Graduate Research Fellowship Program
ID : DGE1745016
Informations de copyright
© 2022 The Authors. Risk Analysis published by Wiley Periodicals LLC on behalf of Society for Risk Analysis.
Références
Adgate, B. (2021, April 13). The impact COVID-19 had on the entertainment industry in 2020. Forbes. https://www.forbes.com/sites/bradadgate/2021/04/13/the-impact-covid-19-had-on-the-entertainment-industry-in-2020/?sh=730a5b38250f
Ancker, J. S., Senathirajah, Y., Kukafka, R., & Starren, J. B. (2006). Design features of graphs in health risk communication: A systematic review. Journal of the American Medical Informatics Association, 13(6), 608-618. https://doi.org/10.1197/jamia.M2115
Cameron, A. C., Gelbach, J. B., & Miller, D. L. (2008). Bootstrap-based improvements for inference with clustered errors. Review of Economics and Statistics, 90(3), 414-427. https://doi.org/10.1162/rest.90.3.414
Crameri, F., Shephard, G. E., & Heron, P. J. (2020). The misuse of colour in science communication. Nature Communications, 11, 5444. https://doi.org/10.1038/s41467-020-19160-7
DGA, SAG-AFTRA, IATSE and Teamsters’. (2020). The safe way forward (Report No. 1). https://www.sagaftra.org/files/sa_documents/ProductionSafetyGuidelines_June2020EditedP.pdf
Fagerlin, A., Zikmund-Fisher, B. J., Ubel, P. A., Jankovic, A., Derry, H. A., & Smith, D. M. (2007). Measuring numeracy without a math test: Development of the subjective numeracy scale. Medical Decision Making, 27(5), 672-680. https://doi.org/10.1177/0272989/07304449
Fagerlin, A., Valley, T., Scherer, A., Knaus, M., Das, E., & Zikmund-Fisher, B. (2017). Communicating infectious disease prevalence through graphics: Results from an international survey. Vaccine, 35(2), 4041-4047. https://doi.org/10.1016/j.vaccine.2017.05.048
Fischhoff, B. (2013). The sciences of science communication. Proceedings of the National Academy of Sciences, 110, 14033-14039. https://doi.org/10.1073/pnas.1213273110
Galesic, M., & Garcia-Retamero, R. (2011). Graph literacy: A cross-cultural comparison. Medical Decision Making, 31(3), 444-457. https://doi.org/10.1177/0272989/10373805
Garcia-Retamero, R., & Cokely, E. T. (2013). Communicating health risks with visual aids. Current Directions in Psychological Science, 22(5), 392-399. https://doi.org/10.1177/0963721413491570
Garcia-Retamero, R., & Cokely, E. T. (2017). Designing visual aids that promote risk literacy: A systematic review of health research and evidence-based design heuristics. Human Factors: The Journal of the Human Factors and Ergonomics Society, 59(4), 582-627. https://doi.org/10.1177/0018720817690634
Hanley, J. A., & McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143(1), 29-36. https://doi.org/10.1148/radiology.143.1.7063747
Kennedy, R., Clifford, S., Burleigh, T., Waggoner, P. D., Jewell, R., & Winter, N. J. (2020). The shape of and solutions to the MTurk quality crisis. Political Science Research and Methods, 8(4), 614-629. https://doi.org/10.1017/psrm.2020.6
King, A. J. (2015). Visual messaging and risk communication. In H. Cho, T. Reimer, & K. A. McComas, (Eds.), The SAGE handbook of risk communication (pp. 193-206). SAGE Publications, Inc. https://doi.org/10.4135/9781483387918.n22
Larkin, J. H., & Simon, H. A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cognitive Science, 11, 65-99.
Li, R., Pei, S., Chen, B., Song, Y., Zhang, T., Yang, W., & Shaman, J. (2020). Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV-2). Science, 368(6490), 489-493. https://doi.org/10.1126/science.abb3221
Lipkus, I. M. (2007). Numeric, verbal, and visual formats of conveying health risks: Suggested best practices and future recommendations. Medical Decision Making, 27(5), 696-713. https://doi.org/10.1177/0272989x07307271
Lipkus, I. M., & Hollands, J. G. (1999). The visual communication of risk. JNCI Monographs, 1999(25), 149-163. https://doi.org/10.1093/oxfordjournals.jncimonographs.a024191
NASEM. (2022). Supporting individual risk assessment during COVID-19. National Academies Press. https://doi.org/10.17226/26629
Okan, Y., Janssen, E., Galesic, M., & Waters, E. A. (2019). Using the short graph literacy scale to predict precursors of health behavior change. Medical Decision Making, 39(3), 183-195. https://doi.org/10.1177/0272989/19829728
Peer, E., Vosgerau, J., & Acquisti, A. (2013). Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavior Research Methods, 46(4), 1023-1031. https://doi.org/10.3758/s13428-013-0434-y
Pei, S., Kandula, S., & Shaman, J. (2020). Differential effects of intervention timing on COVID-19 spread in the United States. Science Advances, 6(49), eabd6370. https://doi.org/10.1126/sciadv.abd6370
Pei, S., & Shaman, J. (2020). Initial simulation of SARS-CoV2 spread and intervention effects in the continental US. https://doi.org/10.1101/2020.03.21.20040303
Peters, E. (2020). Innumeracy in the wild: Misunderstanding and misusing numbers. Oxford University Press.
Reyna, V. F. (2020). Decision-making about risk in the era of the novel coronavirus disease. Chest, 158(4), 1310-1311. https://doi.org/10.1016/j.chest.2020.07.005
Reyna, V. F. (2021). A scientific theory of gist communication and misinformation resistance, with implications for health, education, and policy. Proceedings of the National Academy of Sciences, 118(15), e1912441117. https://doi.org/10.1073/pnas.1912441117
Reyna, V. F., Broniatowski, D. A., & Edelson, S. M. (2021). Viruses, vaccines, and COVID-19: Explaining and improving risky decision-making. Journal of Applied Research in Memory and Cognition, 10(4), 491-509. https://doi.org/10.1016/j.jarmac.2021.08.004
Thorpe, A., Scherer, A. M., Han, P. K. J., Burpo, N., Shaffer, V., Scherer, L., & Fagerlin, A. (2021). Exposure to common geographic COVID-19 prevalence maps and public knowledge, risk perceptions, and behavioral intentions. JAMA Network Open, 4(1), e2033538. https://doi.org/10.1001/jamanetworkopen.2020.33538
WHO. (2020). WHO Director-General's opening remarks at the media briefing on COVID-19. World Health Organization. https://www.who.int/director-general/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19-11-march-2020
Woloshin, S., Dewitt, B., Krishnamurti, T., & Fischhoff, B. (2022). Assessing how consumers interpret and act on results from at-home COVID-19 self-test kits: A randomized clinical trial. JAMA Internal Medicine, 182, 332-341. https://doi.org/10.1001/jamainternmed.2021.8075
Wong-Parodi, G., Fischhoff, B., & Strauss, B. (2014). A method to evaluate the usability of interactive climate change impact decision aids. Climatic Change, 126, 485-493. https://doi.org/10.1007/2s10584-014-1226-9
Yang, Y., Wong-Parodi, G., & Fischhoff, B. (2022). Visual displays for communicating influenza forecasts. Manuscript submitted for publication.