Predictors of Participation for Sexuality Items in a U.S. Population-Based Online Survey.
Demographic characteristics
Online survey
Participation bias
Sex research
Sexuality
Journal
Archives of sexual behavior
ISSN: 1573-2800
Titre abrégé: Arch Sex Behav
Pays: United States
ID NLM: 1273516
Informations de publication
Date de publication:
05 2023
05 2023
Historique:
received:
11
04
2022
accepted:
04
01
2023
revised:
03
01
2023
medline:
26
4
2023
pubmed:
25
1
2023
entrez:
24
1
2023
Statut:
ppublish
Résumé
Online surveys are a popular tool in sex research and it is vital to understand participation bias in these surveys to improve inferences. However, research on this topic is limited and out of date given the increase in online survey methodology and changes in sexual attitudes. This study examined whether demographics and sexual abuse and assault history predict opting into online survey questions about sex. The sample was recruited for a longitudinal mental health study using a probability-based sampling panel developed to represent the US household population. Participants were masked to the inclusion of sexual content and given a choice to opt into sex questions. Analyses were run on raw and weighted responses to adjust for sampling bias. Of the total sample (n = 476, 62.6% female), 69% opted into sex questions. Raw analysis showed that participants were more likely to be younger, have higher education and income, and have a history of sexual abuse or assault. No racial, gender, relationship status, or regional differences were found. After weighting, effect sizes were reduced for most predictor variables, and only a history of sexual abuse or assault still significantly predicted participation. Results suggest that key demographic features do not have a strong association with participation in sex survey questions. Reasons for participation bias stemming from sexual abuse or assault history should be examined further. This study demonstrates how researchers should continue to monitor participation bias in sex survey research as online methodologies and sexual attitudes evolve over time.
Identifiants
pubmed: 36692629
doi: 10.1007/s10508-023-02533-6
pii: 10.1007/s10508-023-02533-6
pmc: PMC9872736
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
1743-1752Informations de copyright
© 2023. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
Références
Barker, W. J., & Perlman, D. (1975). Volunteer bias and personality traits in sexual standards research. Archives of Sexual Behavior, 4(2), 161–171.
pubmed: 1119934
doi: 10.1007/BF01541080
Bernstein, D. P., Ahluvalia, T., Pogge, D., & Handelsman, L. (1997). Validity of the Childhood Trauma Questionnaire in an adolescent psychiatric population. Journal of the American Academy of Child and Adolescent Psychiatry, 36(3), 340–348.
pubmed: 9055514
doi: 10.1097/00004583-199703000-00012
Bernstein, D. P., & Fink, L. (1998). Childhood Trauma Questionnaire: A retrospective self-report manual. The Psychological Corporation.
Bernstein, D. P., Stein, J. A., Newcomb, M. D., Walker, E., Pogge, D., Ahluvalia, T., & Zule, W. (2003). Development and validation of a brief screening version of the Childhood Trauma Questionnaire. Child Abuse & Neglect, 27(2), 169–190.
doi: 10.1016/S0145-2134(02)00541-0
Bilgen, I., Dennis, J. M., & Ganesh, N. (2018). Nonresponse follow-up impact on Amerispeak panel sample composition and representativeness. Chicago, IL: NORC. Retrieved November 30, 2022 from https://amerispeak.norc.org/content/dam/amerispeak/research/pdf/Bilgen_etal_WhitePaper1_NRFU_SampleComposition.pdf
Bogaert, A. F. (1996). Volunteer bias in human sexuality research: Evidence for both sexuality and personality differences in males. Archives of Sexual Behavior, 25(2), 125–140.
pubmed: 8740519
doi: 10.1007/BF02437932
Bouchard, K. N., Stewart, J. G., Boyer, S. C., Holden, R. R., & Pukall, C. F. (2019). Sexuality and personality correlates of willingness to participate in sex research. Canadian Journal of Human Sexuality, 28(1), 26–37.
doi: 10.3138/cjhs.2018-0028
Brick, J. M., & Kalton, G. (1996). Handling missing data in survey research. Statistical Methods in Medical Research, 5(3), 215–238.
pubmed: 8931194
doi: 10.1177/096228029600500302
Catania, J. A., McDermott, L. J., & Pollack, L. M. (1986). Questionnaire response bias and face-to-face interview sample bias in sexuality research. Journal of Sex Research, 22(1), 52–72.
doi: 10.1080/00224498609551289
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Lawrence Erlbaum Associates.
Copas, A. J., Johnson, A. M., & Wadsworth, J. (1997). Assessing participation bias in a sexual behaviour survey: Implications for measuring HIV risk. AIDS, 11(6), 783–790.
pubmed: 9143611
doi: 10.1097/00002030-199706000-00011
Dale, L. P., Davidson, C., & Kolacz, J. (2020). Adverse Traumatic Experiences Scale. Unpublished manual.
Dawson, S. J., Huberman, J. S., Bouchard, K. N., McInnis, M. K., Pukall, C. F., & Chivers, M. L. (2019). Effects of individual difference variables, gender, and exclusivity of sexual attraction on volunteer bias in sexuality research. Archives of Sexual Behavior, 48(8), 2403–2417.
pubmed: 31011994
doi: 10.1007/s10508-019-1451-4
Dunne, M. P., Martin, N. G., Bailey, J. M., Heath, A. C., Bucholz, K. K., Madden, P. A., & Statham, D. J. (1997). Participation bias in a sexuality survey: Psychological and behavioural characteristics of responders and non-responders. International Journal of Epidemiology, 26(4), 844–854.
pubmed: 9279618
doi: 10.1093/ije/26.4.844
Evans, J. R., & Mathur, A. (2018). The value of online surveys: A look back and a look ahead. Internet Research, 28(4), 854–887.
doi: 10.1108/IntR-03-2018-0089
Farkas, G. M., Sine, L. F., & Evans, I. M. (1978). Personality, sexuality, and demographic differences between volunteers and nonvolunteers for a laboratory study of male sexual behavior. Archives of Sexual Behavior, 7(6), 513–520.
pubmed: 742962
doi: 10.1007/BF01541919
Fenton, K. A., Johnson, A. M., McManus, S., & Erens, B. (2001). Measuring sexual behaviour: Methodological challenges in survey research. Sexually Transmitted Infections, 77(2), 84–92.
pubmed: 11287683
pmcid: 1744273
doi: 10.1136/sti.77.2.84
Gaither, G. A., Sellbom, M., & Meier, B. P. (2003). The effect of stimulus content on volunteering for sexual interest research among college students. Journal of Sex Research, 40(3), 240–248.
pubmed: 14533018
doi: 10.1080/00224490309552188
Gewirtz-Meydan, A., Hafford-Letchfield, T., Ayalon, L., Benyamini, Y., Biermann, V., Coffey, A., Jackson, J., Phelan, A., Voß, P., Geiger Zeman, M., & Zeman, Z. (2019). How do older people discuss their own sexuality? A systematic review of qualitative research studies. Culture, Health & Sexuality, 21(3), 293–308.
doi: 10.1080/13691058.2018.1465203
Griffith, M., & Walker, C. E. (1976). Characteristics associated with expressed willingness to participate in psychological research. The Journal of Social Psychology, 100(1), 157–158.
doi: 10.1080/00224545.1976.9711923
Groves, R. M., Cialdini, R. B., & Couper, M. P. (1992). Understanding the decision to participate in a survey. Public Opinion Quarterly, 56(4), 475–495.
doi: 10.1086/269338
Johnson, W. T., & DeLamater, J. D. (1976). Response effects in sex surveys. Public Opinion Quarterly, 40(2), 165–181.
doi: 10.1086/268285
King, B. M. (2022). The influence of social desirability on sexual behavior surveys: A review. Archives of Sexual Behavior, 51, 1495–1501.
pubmed: 35142972
pmcid: 8917098
doi: 10.1007/s10508-021-02197-0
Kolacz, J., Dale, L. P., Nix, E. J., Roath, O. K., Lewis, G. F., & Porges, S. W. (2020a). Adversity history predicts self-reported autonomic reactivity and mental health in US residents during the COVID-19 pandemic. Frontiers in Psychiatry, 11, 1–11.
doi: 10.3389/fpsyt.2020.577728
Kolacz, J., Hu, Y., Gesselman, A. N., Garcia, J. R., Lewis, G. F., & Porges, S. W. (2020b). Sexual function in adults with a history of childhood maltreatment: Mediating effects of self-reported autonomic reactivity. Psychological Trauma: Theory, Research, Practice, and Policy, 12(3), 281–290.
pubmed: 31343207
doi: 10.1037/tra0000498
Loeb, T. B., Rivkin, I., Williams, J. K., Wyatt, G. E., Carmona, J. V., & Chin, D. (2002). Child sexual abuse: Associations with the sexual functioning of adolescents and adults. Annual Review of Sex Research, 13(1), 307–345.
pubmed: 12836735
Lumley, T. (2004). Analysis of complex survey samples. Journal of Statistical Software, 9, 1–19.
doi: 10.18637/jss.v009.i08
Maniglio, R. (2009). The impact of child sexual abuse on health: A systematic review of reviews. Clinical Psychology Review, 29(7), 647–657.
pubmed: 19733950
doi: 10.1016/j.cpr.2009.08.003
McInroy, L. B. (2016). Pitfalls, potentials, and ethics of online survey research: LGBTQ and other marginalized and hard-to-access youths. Social Work Research, 40(2), 83–94.
pubmed: 27257362
pmcid: 4886272
doi: 10.1093/swr/svw005
Morokoff, P. J. (1986). Volunteer bias in the psychophysiological study of female sexuality. Journal of Sex Research, 22(1), 35–51.
doi: 10.1080/00224498609551288
Mustanski, B. S. (2001). Getting wired: Exploiting the Internet for the collection of valid sexuality data. Journal of Sex Research, 38(4), 292–301.
doi: 10.1080/00224490109552100
Nayak, M. S. D. P., & Narayan, K. A. (2019). Strengths and weaknesses of online surveys. Technology, 6(7), 0837–2405053138.
Plaud, J. J., Gaither, G. A., Hegstad, H. J., Rowan, L., & Devitt, M. K. (1999). Volunteer bias in human psychophysiological sexual arousal research: To whom do our research results apply? Journal of Sex Research, 36(2), 171–179.
doi: 10.1080/00224499909551982
R Core Team. (2021). R: A language and environment for statistical computing (Version 4.1.2). Vienna, Austria: R Foundation for Statistical Computing. https://www.R-project.org/
Redfearn, A. A., & Laner, M. R. (2000). The effects of sexual assault on sexual attitudes. Marriage & Family Review, 30(1–2), 109–125.
doi: 10.1300/J002v30n01_08
Riggle, E. D., Rostosky, S. S., & Reedy, C. S. (2005). Online surveys for BGLT research: Issues and techniques. Journal of Homosexuality, 49(2), 1–21.
pubmed: 16048891
doi: 10.1300/J082v49n02_01
Rosenthal, R., & Rosnow, R. L. (1975). The volunteer subject. Wiley.
RStudio Team. (2021). RStudio: Integrated development environment for R. Boston, MA: RStudio, PBC. http://www.rstudio.com/ .
Saunders, D. M., Fisher, W. A., Hewitt, E. C., & Clayton, J. P. (1985). A method for empirically assessing volunteer selection effects: Recruitment procedures and responses to erotica. Journal of Personality and Social Psychology, 49(6), 1703–1712.
doi: 10.1037/0022-3514.49.6.1703
Strassberg, D. S., & Lowe, K. (1995). Volunteer bias in sexuality research. Archives of Sexual Behavior, 24(4), 369–382.
pubmed: 7661653
doi: 10.1007/BF01541853
Twenge, J. M., Sherman, R. A., & Wells, B. E. (2015). Changes in American adults’ sexual behavior and attitudes, 1972–2012. Archives of Sexual Behavior, 44(8), 2273–2285.
pubmed: 25940736
doi: 10.1007/s10508-015-0540-2
Twenge, J. M., Sherman, R. A., & Wells, B. E. (2016). Changes in American adults’ reported same-sex sexual experiences and attitudes, 1973–2014. Archives of Sexual Behavior, 45(7), 1713–1730.
pubmed: 27251639
doi: 10.1007/s10508-016-0769-4
Twenge, J. M., Sherman, R. A., & Wells, B. E. (2017). Declines in sexual frequency among American adults, 1989–2014. Archives of Sexual Behavior, 46(8), 2389–2401.
pubmed: 28265779
doi: 10.1007/s10508-017-0953-1
U.S. Census Bureau. (2020). Current population survey. Retrieved from https://www.census.gov/programs-surveys/cps.html
Van Berlo, W., & Ensink, B. (2000). Problems with sexuality after sexual assault. Annual Review of Sex Research, 11(1), 235–257.
pubmed: 11351833
Wiederman, M. W. (1993). Demographic and sexual characteristics of nonresponders to sexual experience items in a national survey. Journal of Sex Research, 30(1), 27–35.
doi: 10.1080/00224499309551675
Wiederman, M. W. (1999). Volunteer bias in sexuality research using college student participants. Journal of Sex Research, 36(1), 59–66.
doi: 10.1080/00224499909551968
Wolchik, S. A., Braver, S. L., & Jensen, K. (1985). Volunteer bias in erotica research: Effects of intrusiveness of measure and sexual background. Archives of Sexual Behavior, 14(2), 93–107.
pubmed: 3994504
doi: 10.1007/BF01541656
Wolchik, S. A., Spencer, S. L., & Lisi, I. S. (1983). Volunteer bias in research employing vaginal measures of sexual arousal. Archives of Sexual Behavior, 12(5), 399–408.
pubmed: 6651507
doi: 10.1007/BF01542883
Wright, K. B. (2005). Researching Internet-based populations: Advantages and disadvantages of online survey research, online questionnaire authoring software packages, and web survey services. Journal of Computer-Mediated Communication, 10(3). https://doi.org/10.1111/j.1083-6101.2005.tb00259.x