Measuring Spatial Perspective Taking: Analysis of Four Measures Using Item Response Theory.
Individual differences
Item response theory
Spatial cognition
Spatial perspective taking
Journal
Topics in cognitive science
ISSN: 1756-8765
Titre abrégé: Top Cogn Sci
Pays: United States
ID NLM: 101506764
Informations de publication
Date de publication:
01 2023
01 2023
Historique:
revised:
03
12
2021
received:
03
03
2021
accepted:
06
12
2021
pubmed:
16
1
2022
medline:
14
1
2023
entrez:
15
1
2022
Statut:
ppublish
Résumé
Research on spatial thinking requires reliable and valid measures of individual differences in various component skills. Spatial perspective taking (PT)-the ability to represent viewpoints different from one's own-is one kind of spatial skill that is especially relevant to navigation. This study had two goals. First, the psychometric properties of four PT tests were examined: Four Mountains Task (FMT), Spatial Orientation Task (SOT), Perspective-Taking Task for Adults (PTT-A), and Photographic Perspective-Taking Task (PPTT). Using item response theory (IRT), item difficulty, discriminability, and efficiency of item information functions were evaluated. Second, the relation of PT scores to general intelligence, working memory, and mental rotation (MR) was assessed. All tasks showed good construct validity except for FMT. PPTT tapped a wide range of PT ability, with maximum measurement precision at average ability. PTT-A captured a lower range of ability. Although SOT contributed less measurement information than other tasks, it did well across a wide range of PT ability. After controlling for general intelligence and working memory, original and IRT-refined versions of PT tasks were each related to MR. PTT-A and PPTT showed relatively more divergent validity from MR than SOT. Tests of dimensionality indicated that PT tasks share one common PT dimension, with secondary task-specific factors also impacting the measurement of individual differences in performance. Advantages and disadvantages of a hybrid PT test that includes a combination of items across tasks are discussed.
Types de publication
Journal Article
Research Support, U.S. Gov't, Non-P.H.S.
Langues
eng
Sous-ensembles de citation
IM
Pagination
46-74Informations de copyright
© 2022 Cognitive Science Society LLC.
Références
Adams, R. J., Wilson, M., & Wang, W. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21(1), 1-23. https://doi.org/10.1177/0146621697211001
Aichhorn, M., Perner, J., Kronbichler, M., Staffen, W., & Ladurner, G. (2006). Do visual perspective tasks need theory of mind? Neuroimage, 30(3), 1059-1068.
Amorim, M.-A., & Stucchi, N. (1997). Viewer- and object-centered mental explorations of an imagined environment are not equivalent. Cognitive Brain Research, 5(3), 229-239. https://doi.org/10.1016/S0926-6410(96)00073-0
Barratt, E. S. (1953). An analysis of verbal reports of solving spatial problems as an aid in defining spatial factors. The Journal of Psychology, 36(1), 17-25.
Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 443-459.
Bolt, D. M., Cohen, A. S., & Wollack, J. A. (2002). Item parameter estimation under conditions of test speededness: Application of a mixture Rasch model with ordinal constraints. Journal of Educational Measurement, 39(4), 331-348.
Burgess, N., Spiers, H. J., & Paleologou, E. (2004). Orientational manoeuvres in the dark: Dissociating allocentric and egocentric influences on spatial memory. Cognition, 94(2), 149-166.
Burles, F., Slone, E., & Iaria, G. (2017). Dorso-medial and ventro-lateral functional specialization of the human retrosplenial complex in spatial updating and orienting. Brain Structure and Function, 222(3), 1481-1493.
Carr, M., Horan, E., Alexeev, N., Barned, N., Wang, L., & Otumfuor, B. (2020). A longitudinal study of spatial skills and number sense development in elementary school children. Journal of Educational Psychology, 112(1), 53.
Chalmers, R. P. (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1-29.
Chan, D., Gallaher, L. M., Moodley, K., Minati, L., Burgess, N., & Hartley, T. (2016). The 4 mountains test: A short test of spatial memory with high sensitivity for the diagnosis of pre-dementia Alzheimer's disease. Journal of Visualized Experiments, 11(116), e54454.
Chen, W.-H., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22(3), 265-289.
Christensen, K. B., Makransky, G., & Horton, M. (2017). Critical values for Yen's Q 3: Identification of local dependence in the Rasch model using residual correlations. Applied Psychological Measurement, 41(3), 178-194.
Cronbach, L. J. (1957). The two disciplines of scientific psychology. American psychologist, 12(11), 671.
Clements-Stephens, A. M., Vasiljevic, K., Murray, A. J., & Shelton, A. L. (2013). The role of potential agents in making spatial perspective taking social. Frontiers in Human Neuroscience, 7, 497. https://doi.org/10.3389/fnhum.2013.00497
Committeri, G., Galati, G., Paradis, A. L., Pizzamiglio, L., Berthoz, A., & LeBihan, D. (2004). Reference frames for spatial cognition: Different brain areas are involved in viewer-, object-, and landmark-centered judgments about object location. Journal of Cognitive Neuroscience, 16(9), 1517-1535.
Cooper, L. A., & Regan, D. T. (1982). Attention, perception, and intelligence. In R. J. Sternberg (Ed.), Handbook of Human Intelligence (pp. 123-169). New York, NY: Cambridge University Press.
De Ayala, R. J. (2009). The theory and practice of item response theory. New York, NY: Guilford Press.
Draheim, C., Tsukahara, J. S., Martin, J. D., Mashburn, C. A., & Engle, R. W. (2020). A toolbox approach to improving the measurement of attention control. Journal of Experimental Psychology: General, 150(2), 242-275. https://doi.org/10.1037/xge0000783
Drasgow, F., & Lissak, R. I. (1983). Modified parallel analysis: A procedure for examining the latent dimensionality of dichotomously scored item responses. Journal of Applied Psychology, 68(3), 363.
Edelen, M. O., & Reeve, B. B. (2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research, 16(1), 5.
Fan, X. (1998). Item response theory and classical test theory: An empirical comparison of their item/person statistics. Educational and Psychological Measurement, 58(3), 357-381. https://doi.org/10.1177/0013164498058003001
Fields, A. W., & Shelton, A. L. (2006). Individual skill differences and large-scale environmental learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32(3), 506-515. https://doi.org/10.1037/0278-7393.32.3.506
Flake, J. K., Pek, J., & Hehman, E. (2017). Construct validation in social and personality research: Current practice and recommendations. Social Psychological and Personality Science, 8(4), 370-378.
Flavell, J. H., Flavell, E. R., Green, F. L., & Wilcox, S. A. (1981). The development of three spatial perspective-taking rules. Child Development, 52, 356-358. https://doi.org/10.2307/1129250
Foster, J. L., Shipstead, Z., Harrison, T. L., Hicks, K. L., Redick, T. S., & Engle, R. W. (2015). Shortened complex span tasks can reliably measure working memory capacity. Memory & Cognition, 43(2), 226-236. https://doi.org/10.3758/s13421-014-0461-7
Frick, A. (2019). Spatial transformation abilities and their relation to later mathematics performance. Psychological Research, 83(7), 1465-1484. https://doi.org/10.1007/s00426-018-1008-5
Frick, A., & Möhring, W. (2016). A matter of balance: Motor control is related to children's spatial and proportional reasoning skills. Frontiers in Psychology, 6, 2049. https://doi.org/10.3389/fpsyg.2015.02049
Frick, A., Möhring, W., & Newcombe, N. S. (2014). Picturing perspectives: Development of perspective-taking abilities in 4- to 8-year-olds. Frontiers in Psychology, 5, 386. https://doi.org/10.3389/fpsyg.2014.00386
Friedman, A., Kohler, B., Gunalp, P., Boone, A. P., & Hegarty, M. (2019). A computerized spatial orientation test. Behavior Research Methods, 52, 799-812. https://doi.org/10.3758/s13428-019-01277-3
Ganis, G., & Kievit, R. (2015). A new set of three-dimensional shapes for investigating mental rotation processes: Validation data and stimulus set. Journal of Open Psychology Data, 3, e3. http://doi.org/10.5334/jopd.ai
Gibbons, R. D., & Hedeker, D. R. (1992). Full-information item bi-factor analysis. Psychometrika, 57(3), 423-436. https://doi.org/10.1007/BF02295430
Gibbons, R. D., Rush, A. J., & Immekus, J. C. (2009). On the psychometric validity of the domains of the PDSQ: An illustration of the bi-factor item response theory model. Journal of Psychiatric Research, 43(4), 401-410. https://doi.org/10.1016/j.jpsychires.2008.04.013
Hartley, T., Bird, C. M., Chan, D., Cipolotti, L., Husain, M., Vargha-Khadem, F., & Burgess, N. (2007). The hippocampus is required for short-term topographical memory in humans. Hippocampus, 17(1), 34-48. https://doi.org/10.1002/hipo.20240
Hartley, T., & Harlow, R. (2012). An association between human hippocampal volume and topographical memory in healthy young adults. Frontiers in Human Neuroscience, 6, 338. https://doi.org/10.3389/fnhum.2012.00338
Hegarty, M., & Waller, D. (2004). A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence, 32(2), 175-191. https://doi.org/10.1016/j.intell.2003.12.001
Hegarty, M. (2018). Ability and sex differences in spatial thinking: What does the mental rotation test really measure? Psychonomic Bulletin & Review, 25(3), 1212-1219.
Hussey, I., & Hughes, S. (2020). Hidden invalidity among 15 commonly used measures in social and personality psychology. Advances in Methods and Practices in Psychological Science, 3(2), 166-184.
Huttenlocher, J., & Presson, C. C. (1973). Mental rotation and the perspective problem. Cognitive Psychology, 4(2), 277-299. https://doi.org/10.1016/0010-0285(73)90015-7
Jabrayilov, R., Emons, W. H. M., & Sijtsma, K. (2016). comparison of classical test theory and item response theory in individual change assessment. Applied Psychological Measurement, 40(8), 559-572. https://doi.org/10.1177/0146621616664046
Kaiser, S., Walther, S., Nennig, E., Kronmüller, K., Mundt, C., Weisbrod, M., … Vogeley, K. (2008). Gender-specific strategy use and neural correlates in a spatial perspective taking task. Neuropsychologia, 46(10), 2524-2531.
Kessler, K., & Wang, H. (2012). Spatial perspective taking is an embodied process, but not for everyone in the same way: Differences predicted by sex and social skills score. Spatial Cognition & Computation, 12(2-3), 133-158. https://doi.org/10.1080/13875868.2011.634533
Kidd, E., Donnelly, S., & Christiansen, M. H. (2018). Individual differences in language acquisition and processing. Trends in Cognitive Sciences, 22(2), 154-169.
Kozhevnikov, M., & Hegarty, M. (2001). A dissociation between object manipulation spatial ability and spatial orientation ability. Memory & Cognition, 29(5), 745-756. https://doi.org/10.3758/BF03200477
Kozhevnikov, M., Motes, M. A., Rasch, B., & Blajenkova, O. (2006). Perspective-taking vs. mental rotation transformations and how they predict spatial navigation performance. Applied Cognitive Psychology, 20(3), 397-417. https://doi.org/10.1002/acp.1192
Lambrey, S., Doeller, C., Berthoz, A., & Burgess, N. (2012). Imagining being somewhere else: Neural basis of changing perspective in space. Cerebral Cortex, 22(1), 166-174. https://doi.org/10.1093/cercor/bhr101
Lempers, J. D., Flavell, E. R., & Flavell, J. H. (1977). The development in very young children of tacit knowledge concerning visual perception. Genetic Psychology Monographs, 95(1), 3-53.
Liu, Y., Magnus, B., O'Connor, H., & Thissen, D. (2018). Multidimensional item response theory. In P. Irwing, D. Hughes, & T. Booth (Eds.), The Wiley handbook of psychometric testing (pp. 445-493). Hoboken, NJ: Wiley-Blackwell. https://doi.org/10.1002/9781118489772.ch16
Lohman, D. F. (1996). Spatial ability and g. Human Abilities: Their Nature and Measurement, 97(116), 1.
Lohman, D. F. (1979). Spatial ability: A review and reanalysis of the correlational literature. Technical report. School of Education, Stanford University, Stanford, CA.
Lord, F. M., & Novick, M. R. (2008). Statistical theories of mental test scores. Charlotte, NC: Information Age Publishing, Reading, MA.
Magno, C. (2009). Demonstrating the difference between classical test theory and item response theory using derived test data. The International Journal of Educational and Psychological Assessment, 1(1), 1-11.
Masangkay, Z. S., McCluskey, K. A., McIntyre, C. W., Sims-Knight, J., Vaughn, B. E., & Flavell, J. H. (1974). The early development of inferences about the visual percepts of others. Child Development, 45(2), 357-366.
Maydeu-Olivares, A., & Joe, H. (2006). Limited information goodness-of-fit testing in multidimensional contingency tables. Psychometrika, 71(4), 713.
Merkle, E., You, D., Schneider, L., Bae, S., & Merkle, M. E. (2018). Package ‘nonnest2.’ Psychological Methods, 21, 151-163.
Morizot, J., Ainsworth, A. T., & Reise, S. P. (2007). Toward modern psychometrics: Application of item response theory models in personality research. In R. W. Robins, R. C. Fraley, & R. F. Krueger (Eds.), Handbook of Research Methods in Personality Psychology (pp. 407-421).
Nazareth, A., Newcombe, N. S., Shipley, T. F., Velazquez, M., & Weisberg, S. M. (2019). Beyond small-scale spatial skills: Navigation skills and geoscience education. Cognitive Research: Principles and Implications, 4(1), 17. https://doi.org/10.1186/s41235-019-0167-2
Nazareth, A., Weisberg, S. M., Margulis, K., & Newcombe, N. S. (2018). Charting the development of cognitive mapping. Journal of Experimental Child Psychology, 170, 86-106. https://doi.org/10.1016/j.jecp.2018.01.009
Newcombe, N. S., & Shipley, T. F. (2015). Thinking about spatial thinking: New typology, new assessments. In J. S. Gero (Ed.), Studying visual and spatial reasoning for design creativity (pp. 179-192). Dordecht, the Netherlands: Springer Netherlands. https://doi.org/10.1007/978-94-017-9297-4_10
Oldakowski, R. K. (2001). Activities to develop a spatial perspective among students in introductory geography courses. Journal of Geography, 100(6), 243-250. https://doi.org/10.1080/00221340108978451
Orlando, M., & Thissen, D. (2000). Likelihood-based item-fit indices for dichotomous item response theory models. Applied Psychological Measurement, 24(1), 50-64.
Orlando, M., & Thissen, D. (2003). Further investigation of the performance of S-X2: An item fit index for use with dichotomous item response theory models. Applied Psychological Measurement, 27(4), 289-298.
Oshima, T. (1994). The effect of speededness on parameter estimation in item response theory. Journal of Educational Measurement, 31(3), 200-219.
Peters, M., Laeng, B., Latham, K., Jackson, M., Zaiyouna, R., & Richardson, C. (1995). A redrawn Vandenberg and Kuse mental rotations test-Different versions and factors that affect performance. Brain and Cognition, 28(1), 39-58. https://doi.org/10.1006/brcg.1995.1032
Piaget, J., & Inhelder, B. (1956). The child's conception of space. London: Routledge & Kegan Paul.
Pittalis, M., & Christou, C. (2010). Types of reasoning in 3D geometry thinking and their relation with spatial ability. Educational Studies in Mathematics, 75(2), 191-212.
Plummer, J. D., Bower, C. A., & Liben, L. S. (2016). The role of perspective taking in how children connect reference frames when explaining astronomical phenomena. International Journal of Science Education, 38(3), 345-365. https://doi.org/10.1080/09500693.2016.1140921
Rasch, G. (1960). Studies in mathematical psychology: I. Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danmarks paedagogiske Institut.
Reise, S. P., Morizot, J., & Hays, R. D. (2007). The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research, 16(1), 19-31. https://doi.org/10.1007/s11136-007-9183-7
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667-696. https://doi.org/10.1080/00273171.2012.715555
Rizopoulos, D. (2006). ltm: An R package for latent variable modeling and item response analysis. Journal of Statistical Software, 17(1), 1-25. https://doi.org/10.18637/jss.v017.i05
Robitzsch, A. (2019). sirt: Supplementary item response theory models. R package version 3.9-4. https://CRAN.R-project.org/package=sirt
Sahin, A., & Anil, D. (2017). The effects of test length and sample size on item parameters in item response theory. Journal of Educational Sciences: Theory & Practice, 17(1), 321-335. https://doi.org/10.12738/estp.2017.1.0270
Schmiedek, F., Lövdén, M., & Lindenberger, U. (2014). A task is a task is a task: Putting complex span, n-back, and other working memory indicators in psychometric context. Frontiers in Psychology, 5, 1475. https://doi.org/10.3389/fpsyg.2014.01475
Schneider, L., Chalmers, R. P., Debelak, R., & Merkle, E. C. (2019). Model selection of nested and non-nested item response models using Vuong tests. Multivariate Behavioral Research, 55(5), 664-684.
Shelton, A. L., Clements-Stephens, A. M., Lam, W. Y., Pak, D. M., & Murray, A. J. (2012). Should social savvy equal good spatial skills? The interaction of social skills with spatial perspective taking. Journal of Experimental Psychology: General, 141(2), 199-205. https://doi.org/10.1037/a0024617
Shepard, R. N., & Metzler, J. (1971). Mental rotation of three-dimensional objects. Science, 171(3972), 701-703. https://doi.org/10.1126/science.171.3972.701
Tarampi, M. R., Heydari, N., & Hegarty, M. (2016). A tale of two types of perspective taking: Sex differences in spatial ability. Psychological Science, 27(11), 1507-1516.
Tennant, A., & Conaghan, P. G. (2007). The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Care & Research, 57(8), 1358-1362.
Thissen, D., & Steinberg, L. (1986). A taxonomy of item response models. Psychometrika, 51(4), 567-577. https://doi.org/10.1007/BF02295596
Thorpe, G. L., & Favia, A. (2012). Data Analysis using item response theory methodology: An introduction to selected programs and applications.
Toland, M. D. (2014). Practical guide to conducting an item response theory analysis. The Journal of Early Adolescence, 34(1), 120-151. SAGE Publications. https://doi.org/10.1177/0272431613511332
Uttal, D. H., & Cohen, C. A. (2012). Spatial thinking and STEM education: When, why, and how? In B. H. Ross (Ed.), Psychology of learning and motivation (Vol. 57, pp, 148-153). New York, NY: Academic Press. https://doi.org/10.1016/B978-0-12-394293-7.00004-2
Vandenberg, S. G., & Kuse, A. R. (1978). Mental rotations, a group test of three-dimensional spatial visualization. Perceptual and Motor Skills, 47(2), 599-604. https://doi.org/10.2466/pms.1978.47.2.599
Vogeley, K., May, M., Ritzl, A., Falkai, P., Zilles, K., & Fink, G. R. (2004). Neural correlates of first-person perspective as one constituent of human self-consciousness. Journal of Cognitive Neuroscience, 16(5), 817-827.
Voyer, D., Voyer, S., & Bryden, M. P. (1995). Magnitude of sex differences in spatial abilities: A meta-analysis and consideration of critical variables. Psychological Bulletin, 117(2), 250-270. https://doi.org/10.1037/0033-2909.117.2.250
Vuong, Q. H. (1989). Likelihood ratio tests for model selection and non-nested hypotheses. Econometrica, 57(2), 307-333. https://doi.org/10.2307/1912557
Wai, J., Lubinski, D., & Benbow, C. P. (2009). Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. Journal of Educational Psychology, 101(4), 817-835. https://doi.org/10.1037/a0016127
Wechsler, D. (2011). WASI-II: Wechsler abbreviated scale of intelligence. San Antonio, TX: PsychCorp.
Wilkinson, G. S., & Robertson, G. J. (2006). Wide range achievement test (WRAT4). Lutz, FL: Psychological Assessment Resources.
Wraga, M., Creem, S. H., & Proffitt, D. R. (2000). Updating displays after imagined object and viewer rotations. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26(1), 151-168. https://doi.org/10.1037/0278-7393.26.1.151
Xu, J., Paek, I., & Xia, Y. (2017). Investigating the Behaviors of M 2 and RMSEA2 in Fitting a Unidimensional Model to Multidimensional Data. Applied Psychological Measurement, 41(8), 632-644. http://doi.org/10.1177/0146621617710464
Yen, W. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8(2), 125-145.
Zacks, J. M., Mires, J., Tversky, B., & Hazeltine, E. (2000). Mental spatial transformations of objects and perspective. Spatial Cognition and Computation, 2(4), 315-332. https://doi.org/10.1023/A:1015584100204