Mixing mixed-mode designs in a national health interview survey: a pilot study to assess the impact on the self-administered questionnaire non-response.
Health interview survey
Item non-response
Mixed-mode
Self-administered questionnaire
Unit response
Web
Journal
BMC medical research methodology
ISSN: 1471-2288
Titre abrégé: BMC Med Res Methodol
Pays: England
ID NLM: 100968545
Informations de publication
Date de publication:
21 11 2019
21 11 2019
Historique:
received:
11
10
2018
accepted:
31
10
2019
entrez:
23
11
2019
pubmed:
23
11
2019
medline:
6
10
2020
Statut:
epublish
Résumé
Many population health surveys consist of a mixed-mode design that includes a face-to-face (F2F) interview followed by a paper-and-pencil (P&P) self-administered questionnaire (SAQ) for the sensitive topics. In order to alleviate the burden of a supplementary P&P questioning after the interview, a mixed-mode SAQ design including a web and P&P option was tested for the Belgian health interview survey. A pilot study (n = 266, age 15+) was organized using a mixed-mode SAQ design following the F2F interview. Respondents were invited to complete a web SAQ either immediately after the interview or at a later time. The P&P option was offered in case respondents refused or had previously declared having no computer access, no internet connection or no recent usage of computers. The unit response rate for the web SAQ and the overall unit response rate for the SAQ independent of the mode were evaluated. A logistic regression analysis was conducted to explore the association of socio-demographic characteristics and interviewer effects with the completed SAQ mode. Furthermore, a logistic regression analysis assessed the differential user-friendliness of the SAQ modes. Finally, a logistic multilevel model was used to evaluate the item non-response in the two SAQ modes while controlling for respondents' characteristics. Of the eligible F2F respondents in this study, 76% (107/140) agreed to complete the web SAQ. Yet among those, only 78.5% (84/107) actually did. At the end, the overall (web and P&P) SAQ unit response rate reached 73.5%. In this study older people were less likely to complete the web SAQ. Indications for an interviewer effect were observed as regard the number of web respondents, P&P respondents and respondents who refused to complete the SAQ. The web SAQ scored better in terms of user-friendliness and presented higher item response than the P&P SAQ. The web SAQ performed better regarding user-friendliness and item response than the P&P SAQ but the overall SAQ unit response rate was low. Therefore, future research is recommended to further assess which type of SAQ design implemented after a F2F interview is the most beneficial to obtain high unit and item response rates.
Sections du résumé
BACKGROUND
Many population health surveys consist of a mixed-mode design that includes a face-to-face (F2F) interview followed by a paper-and-pencil (P&P) self-administered questionnaire (SAQ) for the sensitive topics. In order to alleviate the burden of a supplementary P&P questioning after the interview, a mixed-mode SAQ design including a web and P&P option was tested for the Belgian health interview survey.
METHODS
A pilot study (n = 266, age 15+) was organized using a mixed-mode SAQ design following the F2F interview. Respondents were invited to complete a web SAQ either immediately after the interview or at a later time. The P&P option was offered in case respondents refused or had previously declared having no computer access, no internet connection or no recent usage of computers. The unit response rate for the web SAQ and the overall unit response rate for the SAQ independent of the mode were evaluated. A logistic regression analysis was conducted to explore the association of socio-demographic characteristics and interviewer effects with the completed SAQ mode. Furthermore, a logistic regression analysis assessed the differential user-friendliness of the SAQ modes. Finally, a logistic multilevel model was used to evaluate the item non-response in the two SAQ modes while controlling for respondents' characteristics.
RESULTS
Of the eligible F2F respondents in this study, 76% (107/140) agreed to complete the web SAQ. Yet among those, only 78.5% (84/107) actually did. At the end, the overall (web and P&P) SAQ unit response rate reached 73.5%. In this study older people were less likely to complete the web SAQ. Indications for an interviewer effect were observed as regard the number of web respondents, P&P respondents and respondents who refused to complete the SAQ. The web SAQ scored better in terms of user-friendliness and presented higher item response than the P&P SAQ.
CONCLUSIONS
The web SAQ performed better regarding user-friendliness and item response than the P&P SAQ but the overall SAQ unit response rate was low. Therefore, future research is recommended to further assess which type of SAQ design implemented after a F2F interview is the most beneficial to obtain high unit and item response rates.
Identifiants
pubmed: 31752714
doi: 10.1186/s12874-019-0860-3
pii: 10.1186/s12874-019-0860-3
pmc: PMC6868753
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
212Références
Eur J Public Health. 2019 Nov 07;:null
pubmed: 31697353
J Med Internet Res. 2011 Sep 27;13(3):e68
pubmed: 21946048
Eur J Epidemiol. 2010 May;25(5):287-96
pubmed: 20191377
Int J Public Health. 2015 Dec;60(8):937-43
pubmed: 26370905
BMC Public Health. 2015 May 07;15:473
pubmed: 25947302
Perspect Public Health. 2011 Mar;131(2):89-94
pubmed: 21462753
BMC Med Res Methodol. 2010 Sep 27;10:83
pubmed: 20868527
Med Care. 2013 Sep;51(9):774-81
pubmed: 23774510
Aust N Z J Public Health. 2012 Apr;36(2):106-8
pubmed: 22487341
Behav Res Methods. 2015 Dec;47(4):1237-1259
pubmed: 25410404
BMC Med Res Methodol. 2019 May 3;19(1):91
pubmed: 31053088
Arch Public Health. 2018 Jan 4;76:8
pubmed: 29423220
Scand J Public Health. 2009 Sep;37(7):758-65
pubmed: 19622549
Ann Epidemiol. 2007 Sep;17(9):643-53
pubmed: 17553702
Value Health. 2008 Mar-Apr;11(2):322-33
pubmed: 18380645
Arch Public Health. 2013 Sep 18;71(1):24
pubmed: 24047278
Int J Public Health. 2011 Aug;56(4):407-17
pubmed: 21538094
J Epidemiol Community Health. 2006 Apr;60(4):290-7
pubmed: 16537344
J Public Health (Oxf). 2005 Sep;27(3):281-91
pubmed: 15870099
PLoS One. 2019 Apr 26;14(4):e0215652
pubmed: 31026300
BMC Public Health. 2013 Feb 23;13:167
pubmed: 23433250