From asking to observing. Behavioural measures of socio-emotional and motivational skills in large-scale assessments.
Behavioral measures
Comparability
Large-scale assessments
Non-cognitive skills
PISA
Journal
Social science research
ISSN: 1096-0317
Titre abrégé: Soc Sci Res
Pays: United States
ID NLM: 0330501
Informations de publication
Date de publication:
05 2023
05 2023
Historique:
received:
19
04
2021
revised:
24
12
2022
accepted:
04
03
2023
medline:
18
4
2023
entrez:
15
4
2023
pubmed:
16
4
2023
Statut:
ppublish
Résumé
Socio-emotional and motivational skills are routinely measured using self-reports in large-scale educational assessments. Measures exploiting test-takers' behaviour during the completion of questionnaires or cognitive tests are increasingly used as alternatives to self-reports in the economics of education literature. We compute behavioural measures of socio-emotional and motivational skills using data from the Programme for International Student Assessment (PISA). We find that these measures capture important aspects of students' academic profiles: some are importantly associated with contemporaneous performance and educational attainment and most measures have a high degree of stability over time. However, these measures are only limitedly correlated among themselves and have low correlations with self-report measures of the same constructs. This is likely a reflection of the fact that behavioural measures are representations of the test taker current 'state', rather than descriptions of the participant view of their own 'trait' like the self-report measures. Moreover, the low correlation across measures suggests that they capture different behavioural responses to the test-taking situation. These differences are still limitedly understood because the measures are constructed ex-post using collateral information collected during the administration of assessments rather than developed ex ante in line with theoretical models of human cognition and affect.
Identifiants
pubmed: 37061327
pii: S0049-089X(23)00029-7
doi: 10.1016/j.ssresearch.2023.102874
pii:
doi:
Types de publication
Journal Article
Langues
eng
Pagination
102874Informations de copyright
Copyright © 2023 The Authors. Published by Elsevier Inc. All rights reserved.