ORCA.IT: A New Web-Based Tool for Assessing Online Reading, Search and Comprehension Abilities in Students Reveals Effects of Gender, School Type and Reading Ability.
assessment
education effects
gender effects
online reading comprehension
reading difficulties
Journal
Frontiers in psychology
ISSN: 1664-1078
Titre abrégé: Front Psychol
Pays: Switzerland
ID NLM: 101550902
Informations de publication
Date de publication:
2019
2019
Historique:
received:
30
06
2019
accepted:
14
10
2019
entrez:
19
11
2019
pubmed:
19
11
2019
medline:
19
11
2019
Statut:
epublish
Résumé
ORCA.IT, a new online test of online research and comprehension was developed for the Italian population. A group of 183 students attending various types of upper secondary schools in Northern Italy were tested with the new tool and underwent further cognitive and neuropsychological assessment. The different school types involved in the study are representative of the school population in the Italian system, but can also be easily compared with the educational systems of other countries. The new test turned out to have good psychometric properties after accurate item construction and final selection. In particular, Version 1 showed better characteristics than Version 2. Subsequently, comparison with one-way ANOVAs were performed to test whether differences exist between different school types, between groups with and without reading difficulties, and between males and females. Such differences are sometimes reported in the literature, but many remain controversial. Further, Pearson's bivariate correlations were calculated to analyze associations between scores on the ORCA.IT and cognitive/neuropsychological variables. Finally, a stepwise regression analysis was performed on aggregated scores to identify the predictors of performance on each of the two versions. The test, especially in the most complete version (Version 1), appears to accurately and reliably capture students' web searching abilities and online reading comprehension. The tool could highlight differences in online search and comprehension ability between students with and without reading difficulties, not penalizing overall performance but allowing very specific weaknesses to be pointed out. Further, it seems to be able to capture differences due to both educational pathways (different school types) and social attitudes (differences between males and females). Most interestingly, it shows to be clearly resting on specific cognitive and neuropsychological abilities, including language, memory, and attentional skills, which explain a large portion of the total variance. Offline text reading comprehension is a crucial predictor of online reading performance, while decoding ability is not. Prior knowledge also influences the results, as expected. The new tool turns out to be rather independent of previous Internet experience and to measure more cognitively grounded processes related to information gathering, processing, and communicating.
Identifiants
pubmed: 31736831
doi: 10.3389/fpsyg.2019.02433
pmc: PMC6839427
doi:
Types de publication
Journal Article
Langues
eng
Pagination
2433Informations de copyright
Copyright © 2019 Caccia, Giorgetti, Toraldo, Molteni, Sarti, Vernice and Lorusso.
Références
Proc Natl Acad Sci U S A. 2018 Oct 2;115(40):9889-9896
pubmed: 30275312
World Psychiatry. 2019 Jun;18(2):119-129
pubmed: 31059635
Surg Obes Relat Dis. 2011 Jul-Aug;7(4):548-57
pubmed: 21514246
Science. 2011 Aug 5;333(6043):776-8
pubmed: 21764755
Comput Human Behav. 2009 Mar;25(2):381-388
pubmed: 32288173
PLoS One. 2015 Jul 16;10(7):e0133544
pubmed: 26181052
Games Health J. 2015 Apr;4(2):95-106
pubmed: 26181803
Proc Natl Acad Sci U S A. 2009 Sep 15;106(37):15583-7
pubmed: 19706386
J Res Spec Educ Needs. 2013 Jan 1;13(1):7-14
pubmed: 26290655
Psychol Bull. 2004 Nov;130(6):858-86
pubmed: 15535741
Front Psychol. 2016 Dec 21;7:1997
pubmed: 28066311
Eur J Neurosci. 2015 Oct;42(8):2546-54
pubmed: 26262779
Front Psychol. 2019 Nov 05;10:2417
pubmed: 31827449
Appl Ergon. 1996 Feb;27(1):61-8
pubmed: 15676313
Psychol Bull. 2016 May;142(5):498-545
pubmed: 26727308
Neurosci Biobehav Rev. 2014 Nov;47:384-92
pubmed: 25265514