oREV: An item response theory-based open receptive vocabulary task for 3- to 8-year-old children.
Individual differences
Item response models
Language development
Vocabulary
Journal
Behavior research methods
ISSN: 1554-3528
Titre abrégé: Behav Res Methods
Pays: United States
ID NLM: 101244316
Informations de publication
Date de publication:
05 Jul 2023
05 Jul 2023
Historique:
accepted:
14
06
2023
medline:
6
7
2023
pubmed:
6
7
2023
entrez:
5
7
2023
Statut:
aheadofprint
Résumé
Individual differences in early language abilities are an important predictor of later life outcomes. High-quality, easy-access measures of language abilities are rare, especially in the preschool and primary school years. The present study describes the construction of a new receptive vocabulary task for children between 3 and 8 years of age. The task was implemented as a browser-based web application, allowing for both in-person and remote data collection via the internet. Based on data from N = 581 German-speaking children, we estimated the psychometric properties of each item in a larger initial item pool via item response modeling. We then applied an automated item selection procedure to select an optimal subset of items based on item difficulty and discrimination. The so-constructed task has 22 items and shows excellent psychometric properties with respect to reliability, stability, and convergent and discriminant validity. The construction, implementation, and item selection process described here makes it easy to extend the task or adapt it to different languages. All materials and code are freely accessible to interested researchers. The task can be used via the following website: https://ccp-odc.eva.mpg.de/orev-demo .
Identifiants
pubmed: 37407786
doi: 10.3758/s13428-023-02169-3
pii: 10.3758/s13428-023-02169-3
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Informations de copyright
© 2023. The Author(s).
Références
Andrich, D. (1982). An index of person separation in latent trait theory, the traditional KR. 20 index, and the Guttman scale response pattern. Education Research and Perspectives, 9(1), 95–104.
Armon-Lotem, S., de Jong, J., & Meir, N. (2015). Introduction. In S. Armon-Lotem, J. de Jong, & N. Meir (Eds.), Assessing multilingual children: Disentangling bilingualism from language impairment (pp. 1–25). Multilingual Matters.
Bayley, N. (2006). Bayley scales of infant and toddler development (3rd ed.). Harcourt Assessment.
Birchenough, J. M., Davies, R., & Connelly, V. (2017). Rated age-of-acquisition norms for over 3,200 German words. Behavior Research Methods, 49(2), 484–501.
pubmed: 26944578
Bleses, D., Makransky, G., Dale, P. S., Højen, A., & Ari, B. A. (2016). Early productive vocabulary predicts academic achievement 10 years later. Applied Psycholinguistics, 37(6), 1461–1476.
Bohnacker, U., Lindgren, J., & Öztekin, B. (2022). Storytelling in bilingual Turkish-Swedish children: Effects of language, age and exposure on narrative macrostructure. Linguistic Approaches to Bilingualism, 12(4), 413–445.
Bornstein, M. H., Hahn, C.-S., Putnick, D. L., & Pearson, R. M. (2018). Stability of core language skill from infancy to adolescence in typical and atypical development. Science Advances, 4(11), eaat7422.
pubmed: 30474055
pmcid: 6248911
Brysbaert, M., & Biemiller, A. (2017). Test-based age-of-acquisition norms for 44 thousand English word meanings. Behavior Research Methods, 49(4), 1520–1523.
pubmed: 27659480
Bürkner, P.-C. (2017). Brms: An r package for Bayesian multilevel models using stan. Journal of Statistical Software, 80(1), 1–28.
Bürkner, P.-C. (2019). Bayesian item response modeling in r with brms and stan. arXiv Preprint arXiv:1905.09501 .
de Mayo, B., Kellier, D., Braginsky, M., Bergmann, C., Hendriks, C., Rowland, C., Frank, M., & Marchman, V. (2021). Web-CDI: A system for online administration of the MacArthur-Bates Communicative Development Inventories. Language Development Research, 1(1), 55–98. https://doi.org/10.34842/kr8e-w591
doi: 10.34842/kr8e-w591
Dunn, L. M., & Dunn, D. M. (2007). Peabody picture vocabulary test, (PPVT-IV): A measure of receptive vocabulary for standard American english, pearson assessments. https://doi.org/10.1002/9780470373699.speced1554
Dunn, L. M., Dunn, L. M., Whetton, C., & Burley, J. (1997). British picture vocabulary scale 2nd edition (BPVS-II). Windsor, Berks: NFER-Nelson.
Embretson, S. E., & Reise, S. P. (2013). Item response theory. Psychology Press.
Fenson, L., et al. (2007). MacArthur-bates communicative development inventories. Brookes Publishing Company Baltimore.
Fiani, R., Henry, G., & Prévost, P. (2022). Macrostructure in narratives produced by Lebanese Arabic-French bilingual children: Developmental trends and links with language dominance, exposure to narratives and lexical skills. Linguistic Approaches to Bilingualism, 12(4), 446–478.
Frank, M. C., Braginsky, M., Yurovsky, D., & Marchman, V. A. (2017). Wordbank: An open repository for developmental vocabulary data. Journal of Child Language, 44(3), 677–694.
pubmed: 27189114
Frank, M. C., Braginsky, M., Yurovsky, D., & Marchman, V. A. (2021). Variability and consistency in early language learning: The wordbank project. MIT Press.
Gershon, R. C., Slotkin, J., Manly, J. J., Blitz, D. L., Beaumont, J. L., Schnipke, D., et al. (2013). IV. NIH toolbox cognition battery (CB): Measuring language (vocabulary comprehension and reading decoding). Monographs of the Society for Research in Child Development, 78(4), 49–69.
pubmed: 23952202
pmcid: 7659464
Glück, C. W., & Glück, C. W. (2011). Wortschatz-und Wortfindungstest für 6-bis 10-jährige (WWT 6–10). Urban & Fischer.
Golinkoff, R. M., De Villiers, J. G., Hirsh-Pasek, K., Iglesias, A., Wilson, M. S., Morini, G., & Brezack, N. (2017). User’s manual for the quick interactive language screener (QUILS): A measure of vocabulary, syntax, and language acquisition skills in young children. Paul H. Brookes Publishing Company.
Golinkoff, R. M., Hoff, E., Rowe, M. L., Tamis-LeMonda, C. S., & Hirsh-Pasek, K. (2019). Language matters: Denying the existence of the 30-million-word gap has serious consequences. Child Development, 90(3), 985–992.
pubmed: 30102419
Haman, E., Łuniewska, M., Hansen, P., Simonsen, H. G., Chiat, S., Bjekić, J., et al. (2017). Noun and verb knowledge in monolingual preschool children across 17 languages: Data from cross-linguistic lexical tasks (LITMUS-CLT). Clinical Linguistics & Phonetics, 31(11–12), 818–843.
Haman, E., Łuniewska, M. & Pomiechowska, B. (2015). Designing cross-linguistic lexical tasks (CLTs) for bilingual preschool children. In S. Armon-Lotem, J. d. Jong & N. Meir (Eds.), Assessing multilingual children: Disentangling bilingualism from Language Impairment (pp. 196– 240). Bristol, UK: Multilingual Matters.
Hoff, E., Quinn, J. M., & Giguere, D. (2018). What explains the correlation between growth in vocabulary and grammar? New evidence from latent change score analyses of simultaneous bilingual development. Developmental Science, 21(2), e12536.
Holland, P. W., & Wainer, H. (2012). Differential item functioning. Routledge.
Jiao, H. (2022). Comparison of different approaches to dealing with guessing in Rasch modeling. Psychological Test and Assessment Modeling, 64(1), 65–86.
Jørgensen, R. N., Dale, P. S., Bleses, D., & Fenson, L. (2010). CLEX: A cross-linguistic lexical norms database. Journal of Child Language, 37(2), 419–428.
pubmed: 19570318
Kauschke, C., & Siegmüller, J. (2002). Patholinguistische Diagnostik bei Sprachentwicklungsstörungen: Diagnostikband Phonologie. Elsevier Urban & Fischer.
Kiese-Himmel, C. (2005). AWST-r-aktiver Wortschatztest für 3-bis 5-jährige Kinder (AWST-r–active vocabulary test for 3-to 5-year-old children). Hogrefe.
Kirkpatrick, S., Gelatt, C. D., Jr., & Vecchi, M. P. (1983). Optimization by simulated annealing. Science, 220(4598), 671–680.
pubmed: 17813860
Kubinger, K. D. (2006). Psychologische diagnostik: Theorie und Praxis psychologischen Diagnostizierens. Hogrefe Verlag.
Kuder, G. F., & Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2(3), 151–160.
Lenhard, A., Lenhard, W., Segerer, R., & Suggate, S. (2015). Peabody picture vocabulary test-4. Ausgabe: Deutsche Fassung. Pearson Assessment.
Lenhard, A., Lenhard, W., Segerer, R., & Suggate, S. (n.d.). Peabody picture vocabulary test-revision IV (deutsche Adaption). Pearson Assessment GmbH.
Lichtenberger, E. O., Sotelo-Dynega, M., & Kaufman, A. S. (2009). The Kaufman assessment battery for children—Second Edition. In J. A. Naglieri & S. Goldstein (Eds.), Practitioner’s guide to assessing intelligence and achievement (pp. 61–93). John Wiley & Sons Inc.
Lindgren, J., & Bohnacker, U. (2022). How do age, language, narrative task, language proficiency and exposure affect narrative macrostructure in German-Swedish bilingual children aged 4 to 6? Linguistic Approaches to Bilingualism, 12(4), 479–508.
Lord, F. M. (2012). Applications of item response theory to practical testing problems. Routledge.
Łuniewska, M., Wodniecka, Z., Miller, C. A., Smolik, F., Butcher, M., Chondrogianni, V., et al. (2019). Age of acquisition of 299 words in seven languages: American English, Czech, Gaelic, Lebanese Arabic, Malay. Persian and Western Armenian. PloS One, 14(8), e0220611.
pubmed: 31393919
Makransky, G., Dale, P. S., Havmose, P., & Bleses, D. (2016). An item response theory–based, computerized adaptive testing version of the MacArthur–bates communicative development inventory: Words & sentences (CDI: WS). Journal of Speech, Language, and Hearing Research, 59(2), 281–289.
pubmed: 27050253
Marchman, V. A., & Fernald, A. (2008). Speed of word recognition and vocabulary knowledge in infancy predict cognitive and language outcomes in later childhood. Developmental Science, 11(3), F9–F16.
pubmed: 18466367
pmcid: 2905590
Mayor, J., & Mani, N. (2019). A short version of the MacArthur–bates communicative development inventories with high validity. Behavior Research Methods, 51(5), 2248–2255.
pubmed: 30306410
Morgan, P. L., Farkas, G., Hillemeier, M. M., Hammer, C. S., & Maczuga, S. (2015). 24-month-old children with larger oral vocabularies display greater academic and behavioral functioning at kindergarten entry. Child Development, 86(5), 1351–1370.
pubmed: 26283023
pmcid: 4567967
Morizot, J., Ainsworth, A., & Reise, S. (2007). Toward modern psychometrics: Application of item response theory models in personality research. In R. W. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 407–421). Guildford Press.
Moyle, M. J., Ellis Weismer, S., Lindstrom, M., et al. (2007). Longitudinal relationships between lexical and grammatical development in typical and late talking children. Journal of Speech, Language, and Hearing Research, 50, 508–528.
pubmed: 17463244
Pace, A., Luo, R., Hirsh-Pasek, K., & Golinkoff, R. M. (2017). Identifying pathways between socioeconomic status and language development. Annual Review of Linguistics, 3, 285–308.
Pace, A., Alper, R., Burchinal, M. R., Golinkoff, R. M., & Hirsh-Pasek, K. (2019). Measuring success: Within and cross-domain predictors of academic and social trajectories in elementary school. Early Childhood Research Quarterly, 46, 112–125.
Schoon, I., Parsons, S., Rush, R., & Law, J. (2010). Children’s language ability and psychosocial development: A 29-year follow-up study. Pediatrics, 126(1), e73–e80.
pubmed: 20587683
Schröder, A., Gemballa, T., Ruppin, S., & Wartenburger, I. (2012). German norms for semantic typicality, age of acquisition, and concept familiarity. Behavior Research Methods, 44(2), 380–394.
pubmed: 22190280
Schröder, S., Würzner, K.-M., Heister, J., Geyken, A., & Kliegl, R. (2015). childLex: A lexical database of German read by children. Behavior Research Methods, 47(4), 1085–1094.
Sivula, T., Magnusson, M., & Vehtari, A. (2020). Uncertainty in Bayesian leave-one-out cross-validation based model comparison. arXiv Preprint arXiv:2008.10296 .
Spaulding, T. J., Hosmer, S., & Schechtman, C. (2013). Investigating the interchangeability and diagnostic utility of the PPVT-III and PPVT-IV for children with and without SLI. International Journal of Speech-Language Pathology, 15(5), 453–462.
pubmed: 23374021
Tsimpli, I. M., Peristeri, E., & Andreou, M. (2016). Narrative production in monolingual and bilingual children with specific language impairment. Applied Psycholinguistics, 37(1), 195–216.
Vehtari, A., Gelman, A., & Gabry, J. (2017). Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Statistics and Computing, 27(5), 1413–1432.
Vehtari, A., Gelman, A., Simpson, D., Carpenter, B., & Bürkner, P.-C. (2021). Rank-normalization, folding, and localization: An improved r for assessing convergence of MCMC (with discussion). Bayesian Analysis, 16(2), 667–718.
Walker, D., Greenwood, C., Hart, B., & Carta, J. (1994). Prediction of school outcomes based on early language production and socioeconomic factors. Child Development, 65(2), 606–621.
pubmed: 8013242
Wechsler, D., & Kodama, H. (1949). Wechsler intelligence scale for children (1st ed.). Psychological corporation New York.