Improving access to COVID-19 information by ensuring the readability of government websites.
COVID 19
Flesch
SMOG
plain English
readability
website
Journal
Health promotion journal of Australia : official journal of Australian Association of Health Promotion Professionals
ISSN: 1036-1073
Titre abrégé: Health Promot J Austr
Pays: Australia
ID NLM: 9710936
Informations de publication
Date de publication:
Apr 2023
Apr 2023
Historique:
revised:
26
04
2022
received:
11
01
2022
accepted:
27
04
2022
medline:
1
5
2023
pubmed:
11
5
2022
entrez:
10
5
2022
Statut:
ppublish
Résumé
This study evaluated the readability of web pages from two public-facing Victorian government websites that were responsible for communicating key health messages relating to the COVID-19 pandemic in 2020. Webpages were downloaded and filtered to identify relevant materials (English language materials containing HTML files that referred to COVID-19). The files were converted to text files and two Python packages, SpaCy and TextStat were used to obtain the data presented here. In addition to running two well-established readability tests, SMOG Index (Simple Measure of Gobbledygook) and Flesch Reading Ease formula, we also calculated the figures for sentence length and word length, which drive the readability measures and allow a disaggregated view of the data. Type token ratio measures were conducted as a reflection of the breadth of vocabulary used in the web pages. Derived measures of text complexity were higher than recommended levels of text complexity for health promotion materials, which are generally set at senior primary school levels. This did not vary depending on the intended audience (public or professional). A senior secondary reading level was required for effective engagement with the text published on both sites. Improving the readability of materials on key government websites where information about COVID-19 is being communicated to the public, represents a low cost and potentially effective means of improving public understanding of the pandemic and the steps individuals need to take to protect themselves and the community. SO WHAT?: Given the challenges widely identified in ensuring compliance with protective behaviours, confidence in seeking vaccination and increasing distrust of government, it would be strategic to improve public communication to ensure health messages are simple and readily understood. The complexity and readability of text contained in web pages during 2020 from two Victorian government departments were evaluated. Communication regarding the restrictions and the management of risks associated with COVID-19 was the main focus of these 367 individual web pages from the Department of Health and Human Services (DHHS) and the Department of Education and Training (DET). Results indicated that across both sites and on both readability measures used, an education level equivalent to senior secondary school would be required to readily understand the contents.
Identifiants
pubmed: 35535619
doi: 10.1002/hpja.610
pmc: PMC9347398
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
595-602Informations de copyright
© 2022 The Authors. Health Promotion Journal of Australia published by John Wiley & Sons Australia, Ltd on behalf of Australian Health Promotion Association.
Références
Basch CH, Mohlman J, Hillyer GC, Garcia P. Public health communication in time of crisis: readability of on-line COVID-19 information. Disaster Med Public Health Prep. 2020;14(5):635-7.
Azios JH, Bellon-Harn M, Dockens AL, Manchaiah V. Quality and readability of English-language internet information for aphasia. Int J Speech Lang Pathol. 2019;21(1):1-9.
Papadakos JK, Charow RC, Papadakos CJ, Moody LJ, Giuliani ME. Evaluating cancer patient-reported outcome measures: readability and implications for clinical use. Cancer. 2019;125(8):1350-6.
Szmuda T, Özdemir C, Ali S, Singh A, Syed MT, Słoniewski P. Readability of online patient education material for the novel coronavirus disease (COVID-19): a cross-sectional health literacy study. Public Health. 2020;185:21-5.
Ferguson C, Merga M, Winn S. Communications in the time of a pandemic: the readability of documents for public consumption. Aust N Z J Public Health. 2021;45(2):116-21.
Tanton R, Peel D, Vidyattama Y. Every suburb Every town: poverty in Victoria. Victoria, Australia; 2018.
Victoria's diverse population: 2016 Census State of Victoria, Victoria. 2017. Available from: https://www.vic.gov.au/sites/default/files/2019-08/Victorias-Diverse-Population-brochure-2016.pdf.
Mac OA, Muscat D, Ayre J, Patel P, McCaffery KJ. Coronavirus (COVID-19) vaccination information must pay attention to health literacy: analysis of readability of official COVID-19 public health information. Med J Aust. 2021;215:373-5.
Mac OA, Muscat DM, Ayre J, Patel P, McCaffery KJ. The readability of official public health information on COVID-19. Med J Aust. 2021;215(8):373-5.
Smith JA, Judd J. COVID-19: vulnerability and the power of privilege in a pandemic. Health Promot J Austr. 2020;31(2):158-60.
Albright J, de Guzman C, Acebo P, Paiva D, Faulkner M, Swanson J. Readability of patient education materials: implications for clinical practice. Appl Nurs Res. 1996;9(3):139-43.
Boulos MNK. British internet-derived patient information on diabetes mellitus: is it readable? Diabetes Technol Ther. 2005;7(3):528-35.
James N. The readability debate 2016. Available from: https://www.plainenglishfoundation.com/documents/10179/54323/PEF-Neil_James-The_readability_debate.pdf
Literacy and access. 2021. Available from: https://www.stylemanual.gov.au/user-needs/understanding-needs/literacy-and-access
Programme for the International Assessment of Adult Competencies, Australia 2013. Available from: https://www.abs.gov.au/ausstats/abs@.nsf/DOSSbyTopic/0997C269D99F3EDBCA257B260079BE3E?OpenDocument
McLellan T, Dobinson G. Tertiary education of journalists and the readability of Australian newspapers. Aust Journal Rev. 2004;26(1):155-74.
COVID-19: a chronology of state and territory government announcements (up until 30 June 2020) 2020 Oct 22. Available from: https://www.aph.gov.au/About_Parliament/Parliamentary_Departments/Parliamentary_Library/pubs/rp/rp2021/Chronologies/COVID-19StateTerritoryGovernmentAnnouncements
Mishra V, Dexter JP. Comparison of readability of official public health information about COVID-19 on websites of international agencies and the governments of 15 countries. JAMA Netw Open. 2020;3(8):e2018033.
Wrigley Kelly N, Murray K, McCarthy C, O'Shea D. An objective analysis of quality and readability of online information on COVID-19. Health Technol. 2021;11(5):1093-9.
Worrall AP, Connolly MJ, O'Neill A, O'Doherty M, Thornton KP, McNally C, et al. Online readability of COVID-19 health information: a comparison between four English speaking countries. BMC Public Health. 2020;20(1):1635.
Halboub E, Al-Ak'hali MS, Al-Mekhlafi HM, Alhajj MN. Quality and readability of web-based Arabic health information on COVID-19: an infodemiological study. BMC Public Health. 2021;21(1):1-7.
Industrial-strength natural language processing in Python. 2021. Available from: https://spacy.io/.
Partalidou E, Spyromitros-Xioufis E, Doropoulos S, Vologiannidis S, Diamantaras KI. Design and implementation of an open source Greek POS tagger and entity recognizer using spaCy. 2019 IEEE/WIC/ACM international conference on web intelligence (WI); 2019 14-17 Oct; 2019.
Hüning M, Hüning M. TextStat simple text analysis tool. Berlin: Dutch Linguistics, Free University of Berlin; 2005.
Mc Laughlin GH. SMOG grading-a new readability formula. J Read. 1969;12(8):639-46.
Henry SL. Referencing and linking to WAI guidelines and technical documents. 2018. Available from: https://www.w3.org/WAI/standards-guidelines/linking/
Flesch R. How to write plain English. University of Canterbury. 1979 [cited 2016 Feb 5]. Available from: https://pages.stern.nyu.edu/~wstarbuc/Writing/Flesch.htm
Flesch R. A new readability yardstick. J Appl Psychol. 1948;32(3):221-33.
Clear language and writing style. Available from: https://www.stylemanual.gov.au/writing-and-designing-content/clear-language-and-writing-style#readability
Flesch RF. The Art of readable writing. 1949.
Berg SH, O'Hara JK, Shortt MT, Thune H, Brønnick KK, Lungu DA, et al. Health authorities' health risk communication with the public during pandemics: a rapid scoping review. BMC Public Health. 2021;21(1):1-23.