What over 1,000,000 participants tell us about online research protocols.
behavioral research methods
crowdsourcing
experimental psychology
online methods
online research
research methodology
survey research methods
Journal
Frontiers in human neuroscience
ISSN: 1662-5161
Titre abrégé: Front Hum Neurosci
Pays: Switzerland
ID NLM: 101477954
Informations de publication
Date de publication:
2023
2023
Historique:
received:
24
05
2023
accepted:
23
06
2023
medline:
24
7
2023
pubmed:
24
7
2023
entrez:
24
7
2023
Statut:
epublish
Résumé
With the ever-increasing adoption of tools for online research, for the first time we have visibility on macro-level trends in research that were previously unattainable. However, until now this data has been siloed within company databases and unavailable to researchers. Between them, the online study creation and hosting tool Gorilla Experiment Builder and the recruitment platform Prolific hold metadata gleaned from millions of participants and over half a million studies. We analyzed a subset of this data (over 1 million participants and half a million studies) to reveal critical information about the current state of the online research landscape that researchers can use to inform their own study planning and execution. We analyzed this data to discover basic benchmarking statistics about online research that all researchers conducting their work online may be interested to know. In doing so, we identified insights related to: the typical study length, average completion rates within studies, the most frequent sample sizes, the most popular participant filters, and gross participant activity levels. We present this data in the hope that it can be used to inform research choices going forward and provide a snapshot of the current state of online research.
Identifiants
pubmed: 37484919
doi: 10.3389/fnhum.2023.1228365
pmc: PMC10357382
doi:
Types de publication
Journal Article
Langues
eng
Pagination
1228365Informations de copyright
Copyright © 2023 Tomczak, Gordon, Adams, Pickering, Hodges and Evershed.
Déclaration de conflit d'intérêts
JE was CEO and NH the CTO of Cauldron Science (Gorilla Experiment Builder), and JT, JA, and JP are employees of Cauldron Science. AG was an employee of Prolific.
Références
J Pers Soc Psychol. 2016 Oct;111(4):493-504
pubmed: 27295328
Brain Sci. 2020 Apr 24;10(4):
pubmed: 32344671
Dental Press J Orthod. 2014 Jul-Aug;19(4):27-9
pubmed: 25279518
Behav Res Methods. 2020 Feb;52(1):388-407
pubmed: 31016684
Behav Res Methods. 2021 Aug;53(4):1407-1425
pubmed: 33140376
BMJ Open. 2021 Feb 23;11(2):e043866
pubmed: 33622948
J Med Internet Res. 2011 Nov 18;13(4):e96
pubmed: 22100793
Behav Res Methods. 2016 Sep;48(3):1086-99
pubmed: 26170056
Nat Rev Neurosci. 2013 May;14(5):365-76
pubmed: 23571845
PLoS One. 2023 Mar 14;18(3):e0279720
pubmed: 36917576
Behav Res Methods. 2022 Aug;54(4):1643-1662
pubmed: 34590289