Distinct but related abilities for visual and haptic object recognition.
Haptic perception
Individual differences
Latent variable modeling
Object recognition
Visual perception
Journal
Psychonomic bulletin & review
ISSN: 1531-5320
Titre abrégé: Psychon Bull Rev
Pays: United States
ID NLM: 9502924
Informations de publication
Date de publication:
21 Feb 2024
21 Feb 2024
Historique:
accepted:
29
01
2024
medline:
21
2
2024
pubmed:
21
2
2024
entrez:
21
2
2024
Statut:
aheadofprint
Résumé
People vary in their ability to recognize objects visually. Individual differences for matching and recognizing objects visually is supported by a domain-general ability capturing common variance across different tasks (e.g., Richler et al., Psychological Review, 126, 226-251, 2019). Behavioral (e.g., Cooke et al., Neuropsychologia, 45, 484-495, 2007) and neural evidence (e.g., Amedi, Cerebral Cortex, 12, 1202-1212, 2002) suggest overlapping mechanisms in the processing of visual and haptic information in the service of object recognition, but it is unclear whether such group-average results generalize to individual differences. Psychometrically validated measures are required, which have been lacking in the haptic modality. We investigate whether object recognition ability is specific to vision or extends to haptics using psychometric measures we have developed. We use multiple visual and haptic tests with different objects and different formats to measure domain-general visual and haptic abilities and to test for relations across them. We measured object recognition abilities using two visual tests and four haptic tests (two each for two kinds of haptic exploration) in 97 participants. Partial correlation and confirmatory factor analyses converge to support the existence of a domain-general haptic object recognition ability that is moderately correlated with domain-general visual object recognition ability. Visual and haptic abilities share about 25% of their variance, supporting the existence of a multisensory domain-general ability while leaving a substantial amount of residual variance for modality-specific abilities. These results extend our understanding of the structure of object recognition abilities; while there are mechanisms that may generalize across categories, tasks, and modalities, there are still other mechanisms that are distinct between modalities.
Identifiants
pubmed: 38381302
doi: 10.3758/s13423-024-02471-x
pii: 10.3758/s13423-024-02471-x
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Informations de copyright
© 2024. The Psychonomic Society, Inc.
Références
Amedi, A. (2002). Convergence of visual and tactile shape processing in the human lateral occipital complex. Cerebral Cortex, 12(11), 1202–1212. https://doi.org/10.1093/cercor/12.11.1202
doi: 10.1093/cercor/12.11.1202
pubmed: 12379608
Amedi, A., Malach, R., Hendler, T., Peled, S., & Zohary, E. (2001). Visuo-haptic object-related activation in ventral visual pathway. Nature Neuroscience, 4(3), 324–330
Arnott, S. R., Thaler, L., Milne, J. L., Kish, D., & Goodale, M. A. (2013). Shape-specific activation of occipital cortex in an early blind echolocation expert. Neuropsychologia, 51(5), 938–949. https://doi.org/10.1016/j.neuropsychologia.2013.01.024
doi: 10.1016/j.neuropsychologia.2013.01.024
pubmed: 23391560
Borghi, A. M. (2004). Object concepts and action: Extracting affordances from objects parts. Acta Psychologica, 115(1), 69–96. https://doi.org/10.1016/j.actpsy.2003.11.004
doi: 10.1016/j.actpsy.2003.11.004
pubmed: 14734242
Callender, J. C., & Osburn, H. G. (1979). An empirical comparison of coefficient alpha, Guttman’s Lambda-2, and MSPLIT maximized split-half reliability estimates. Journal of Educational Measurement, 16(2), 89–99. https://doi.org/10.1111/j.1745-3984.1979.tb00090.x
doi: 10.1111/j.1745-3984.1979.tb00090.x
Chang, T.-Y., & Gauthier, I. (2021). Domain-specific and domain-general contributions to reading musical notation. Attention, Perception, & Psychophysics, 83(7), 2983–2994. https://doi.org/10.3758/s13414-021-02349-3
doi: 10.3758/s13414-021-02349-3
Cheung, O., Hayward, W.G., Gauthier, I. (2009). Dissociating the effects of angular disparity and image similarity in mental rotation and object recognition. Cognition, 113(1), 128–133
Chow, J. K., Palmeri, T. J., & Gauthier, I. (2022a). Haptic object recognition based on shape relates to visual object recognition ability. Psychological Research, 86(4), 1262–1273. https://doi.org/10.1007/s00426-021-01560-z
doi: 10.1007/s00426-021-01560-z
pubmed: 34355269
Chow, J. K., Palmeri, T. J., & Gauthier, I. (2022b). Visual object recognition ability is not related to experience with visual arts. Journal of Vision, 22(7), 1. https://doi.org/10.1167/jov.22.7.1
doi: 10.1167/jov.22.7.1
pubmed: 35648634
pmcid: 9172047
Chow, J. K., Palmeri, T. J., Pluck, G., & Gauthier, I. (2023). Evidence for an amodal domain-general object recognition ability. Cognition, 238, 105542. https://doi.org/10.1016/j.cognition.2023.105542
doi: 10.1016/j.cognition.2023.105542
pubmed: 37419065
Chua, K.-W., Bub, D. N., Masson, M. E. J., & Gauthier, I. (2018). Grasp representations depend on knowledge and attention. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(2), 268–279. https://doi.org/10.1037/xlm0000453
doi: 10.1037/xlm0000453
pubmed: 28933905
Cook, D. A., & Beckman, T. J. (2006). Current concepts in validity and reliability for psychometric instruments: Theory and application. The American Journal of Medicine, 119(2), 166.e7-166.e16. https://doi.org/10.1016/j.amjmed.2005.10.036
doi: 10.1016/j.amjmed.2005.10.036
pubmed: 16443422
Cooke, T., Jäkel, F., Wallraven, C., & Bülthoff, H. H. (2007). Multimodal similarity and categorization of novel, three-dimensional objects. Neuropsychologia, 45(3), 484–495. https://doi.org/10.1016/j.neuropsychologia.2006.02.009
doi: 10.1016/j.neuropsychologia.2006.02.009
pubmed: 16580027
Craddock, M., & Lawson, R. (2008). Repetition priming and the haptic recognition of familiar and unfamiliar objects. Perception & Psychophysics, 70(7), 1350–1365. https://doi.org/10.3758/PP.70.7.1350
doi: 10.3758/PP.70.7.1350
Dienes, Z. (2014). Using Bayes to get the most out of non-significant results. Frontiers in Psychology, 5. https://doi.org/10.3389/fpsyg.2014.00781
Duchaine, B., & Nakayama, K. (2006). The Cambridge Face Memory Test: Results for neurologically intact individuals and an investigation of its validity using inverted face stimuli and prosopagnosic participants. Neuropsychologia, 44(4), 576–585. https://doi.org/10.1016/j.neuropsychologia.2005.07.001
doi: 10.1016/j.neuropsychologia.2005.07.001
pubmed: 16169565
Fairchild, G. T., Marini, F., & Snow, J. C. (2021). Graspability modulates the stronger neural signature of motor preparation for real objects vs. pictures. Journal of Cognitive Neuroscience, 33(12), 2477–2493. https://doi.org/10.1162/jocn_a_01771
doi: 10.1162/jocn_a_01771
pubmed: 34407193
pmcid: 9946154
Feinberg, T. E., Gonzalez Rothi, L. J., & Heilman, K. M. (1986). Multimodal agnosia after unilateral left hemisphere lesion. Neurology, 36(6), 864–864. https://doi.org/10.1212/WNL.36.6.864
doi: 10.1212/WNL.36.6.864
pubmed: 3703298
Freud, E., Macdonald, S. N., Chen, J., Quinlan, D. J., Goodale, M. A., & Culham, J. C. (2018). Getting a grip on reality: Grasping movements directed to real objects and images rely on dissociable neural representations. Cortex, 98, 34–48. https://doi.org/10.1016/j.cortex.2017.02.020
doi: 10.1016/j.cortex.2017.02.020
pubmed: 28431740
Gaissert, N., Wallraven, C., Bülthoff, H. H., & Bulthoff, H. H. (2010). Visual and haptic perceptual spaces show high similarity in humans. Journal of Vision, 10(11), 2. https://doi.org/10.1167/10.11.2
doi: 10.1167/10.11.2
pubmed: 20884497
Gauthier, I., & Tarr, M.J., (2016). Visual object recognition: Do we (finally) know more now than we did?. Annual Review of Vision Science, 2,377–396
Gauthier, I., Hayward, W.G., Tarr, M.J., Anerson, A.W., Skudlarski, P., & Gore, J.C. (2002) Bold activity during mental rotation and viewpoint-dependent object recognition. Neuron, 34(1), 1617–171
Gomez, J., Pestilli, F., Witthoft, N., Golarai, G., Liberman, A., Poltoratski, S., Yoon, J., & Grill-Spector, K. (2015). Functionally defined white matter reveals segregated pathways in human ventral temporal cortex associated with category-specific processing. Neuron, 85(1), 216–227. https://doi.org/10.1016/j.neuron.2014.12.027
doi: 10.1016/j.neuron.2014.12.027
pubmed: 25569351
pmcid: 4287959
Goodhew, S. C., & Edwards, M. (2019). Translating experimental paradigms into individual-differences research: Contributions, challenges, and practical recommendations. Consciousness and Cognition, 69, 14–25. https://doi.org/10.1016/j.concog.2019.01.008
doi: 10.1016/j.concog.2019.01.008
pubmed: 30685513
Gori, M., del Viva, M., Sandini, G., & Burr, D. C. (2008). Young children do not integrate visual and haptic form information. Current Biology, 18(9), 694–698. https://doi.org/10.1016/j.cub.2008.04.036
doi: 10.1016/j.cub.2008.04.036
pubmed: 18450446
Grzeczkowski, L., Clarke, A. M., Francis, G., Mast, F. W., & Herzog, M. H. (2017). About individual differences in vision. Vision Research, 141, 282–292. https://doi.org/10.1016/j.visres.2016.10.006
doi: 10.1016/j.visres.2016.10.006
pubmed: 27919676
Hayward, W.G., Zhou, G., Gauthier, I., & Harris, I.M. (2006). Dissociating viewpoint costs in mental rotation and object recognition. Psychonomic Bulletin & Review, 13(5), 820–825
Hedge, C., Powell, G., & Sumner, P. (2017). The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences. Behavior Research Methods, 50, 1166–1186. https://doi.org/10.3758/s13428-017-0935-1
doi: 10.3758/s13428-017-0935-1
pmcid: 5990556
Hoffman, K. L. (2008). Category-specific responses to faces and objects in primate auditory cortex. Frontiers in Systems Neuroscience, 1. https://doi.org/10.3389/neuro.06.002.2007
James, T. W., Shima, D. W., Tarr, M. J., & Gauthier, I. (2005). Generating complex three-dimensional stimuli (Greebles) for haptic expertise training. Behavior Research Methods, 37(2), 353–358. https://doi.org/10.3758/BF03192703
doi: 10.3758/BF03192703
pubmed: 16171207
James, T. W., James, K. H., Humphrey, G. K., & Goodale, M. A. (2006). Do visual and tactile object representations share the same neural substrate? In M. A. Heller & S. Ballesteros (Eds.), Touch and blindness: Psychology and neuroscience (pp. 139–155). Erlbaum.
James, T.W., Kim, S., & Fisher, J.S. (2007). The neural basis of haptic object processing. Canadian Journal of Experimental Psychology/Revenue canadeinne de psychologie experimentale, 61(3), 219
Jeffreys, H. (1961). The theory of probability (3rd ed.). Oxford University Press. https://doi.org/10.1063/1.3057804
doi: 10.1063/1.3057804
Kalisch, T., Kattenstroth, J.-C., Kowalewski, R., Tegenthoff, M., & Dinse, H. R. (2012). Cognitive and tactile factors affecting human haptic performance in later life. PLOS ONE, 7(1), e30420. https://doi.org/10.1371/journal.pone.0030420
doi: 10.1371/journal.pone.0030420
pubmed: 22291952
pmcid: 3264587
Kassuba, T., Menz, M. M., Röder, B., & Siebner, H. R. (2013). Multisensory interactions between auditory and haptic object recognition. Cerebral Cortex, 23(5), 1097–1107. https://doi.org/10.1093/cercor/bhs076
doi: 10.1093/cercor/bhs076
pubmed: 22518017
Kim, J.-K., & Zatorre, R. J. (2011). Tactile-auditory shape learning engages the lateral occipital complex. Journal of Neuroscience, 31(21), 7848–7856. https://doi.org/10.1523/JNEUROSCI.3399-10.2011
doi: 10.1523/JNEUROSCI.3399-10.2011
pubmed: 21613498
Kleiner, M., Brainard, D., & Pelli, D. (2006). What’s new in Psychtoolbox-3? Perception, 36, 1–16.
Lacey, S., Campbell, C., & Sathian, K. (2007). Vision and Touch: Multiple or Multisensory Representations of Objects? Perception, 36(10), 1513–1521. https://doi.org/10.1068/p5850
doi: 10.1068/p5850
pubmed: 18265834
Lacey, S., Pappas, M., Kreps, A., Lee, K., & Sathian, K. (2009). Perceptual learning of view-independence in visuo-haptic object representations. Experimental Brain Research, 198(2/3), 329–337. https://doi.org/10.1007/s00221-009-1856-8
doi: 10.1007/s00221-009-1856-8
pubmed: 19484467
pmcid: 2987670
Lacey, S., Flueckiger, P., Stilla, R., Lava, M., & Sathian, K. (2010). Object familiarity modulates the relationship between visual object imagery and haptic shape perception. NeuroImage, 49(3), 1977–1990. https://doi.org/10.1016/j.neuroimage.2009.10.081
doi: 10.1016/j.neuroimage.2009.10.081
pubmed: 19896540
Lacey, S., Lin, J. B., & Sathian, K. (2011). Object and spatial imagery dimensions in visuo-haptic representations. Experimental Brain Research, 213, 267–273. https://doi.org/10.1007/s00221-011-2623-1
doi: 10.1007/s00221-011-2623-1
pubmed: 21424255
pmcid: 3121910
Lacey, S., Stilla, R., Sreenivasan, K., Deshpande, G., & Sathian, K. (2014). Spatial imagery in haptic shape perception. Neuropsychologia, 60(1), 144–158. https://doi.org/10.1016/j.neuropsychologia.2014.05.008
doi: 10.1016/j.neuropsychologia.2014.05.008
pubmed: 25017050
pmcid: 4122331
Lederman, S. J., & Klatzky, R. L. (1987). Hand movements: A window into haptic object recognition. Cognitive Psychology, 19(3), 342–368. https://doi.org/10.1016/0010-0285(87)90008-9
doi: 10.1016/0010-0285(87)90008-9
pubmed: 3608405
Lee Masson, H., Bulthé, J., de Beeck OP, H. P., & Wallraven, C. (2016). Visual and haptic shape processing in the human brain: Unisensory processing, multisensory convergence, and top-down influences. Cerebral Cortex, 26(8), 3402–3412. https://doi.org/10.1093/cercor/bhv170
doi: 10.1093/cercor/bhv170
pubmed: 26223258
Lee Masson, H., Wallraven, C., & Petit, L. (2017). “Can touch this”: Cross-modal shape categorization performance is associated with microstructural characteristics of white matter association pathways. Human Brain Mapping, 38(2), 842–854. https://doi.org/10.1002/hbm.23422
doi: 10.1002/hbm.23422
pubmed: 27696592
McGugin, R. W., Richler, J. J., Herzmann, G., Speegle, M., & Gauthier, I. (2012). The Vanderbilt Expertise Test reveals domain-general and domain-specific sex effects in object recognition. Vision Research, 69, 10–22. https://doi.org/10.1016/j.visres.2012.07.014
doi: 10.1016/j.visres.2012.07.014
pubmed: 22877929
pmcid: 3513270
McGugin, R. W., Sunday, M. A., & Gauthier, I. (2022). The neural correlates of domain-general visual ability. Cerebral Cortex. https://doi.org/10.1093/cercor/bhac342
Meyer, K., Sommer, W., & Hildebrandt, A. (2021). Reflections and new perspectives on face cognition as a specific socio-cognitive ability. Journal of Intelligence, 9(2), 30. https://doi.org/10.3390/jintelligence9020030
doi: 10.3390/jintelligence9020030
pubmed: 34207993
pmcid: 8293405
Newell, F. N., Ernst, M. O., Tjan, B. S., & Bülthoff, H. H. (2001). Viewpoint dependence in visual and haptic object recognition. Psychological Science, 12(1), 37–42. https://doi.org/10.1111/1467-9280.00307
doi: 10.1111/1467-9280.00307
pubmed: 11294226
Ohtake, H., Fujii, T., Yamadori, A., Fujimori, M., Hayakawa, Y., & Suzuki, K. (2001). The influence of misnaming on object recognition: A case of multimodal agnosia. Cortex, 37(2), 175–186. https://doi.org/10.1016/S0010-9452(08)70566-5
doi: 10.1016/S0010-9452(08)70566-5
pubmed: 11394719
Oldfield, R. C. C. (1971). The assessment and analysis of handedness: The Edinburgh Inventory. Neuropsychologia, 9(1), 97–113. https://doi.org/10.1016/0028-3932(71)90067-4
doi: 10.1016/0028-3932(71)90067-4
pubmed: 5146491
Peissig, J.J., &Tarr, M.J. (2007). Visual object recognition: Do we know more now than we did 20 years ago?. Annual Review Psychology, 58, 75-96
Reed, C. L., Lederman, S. J., & Klatzky, R. L. (1990). Haptic integration of planar size with hardness, texture, and planar contour. Canadian Journal of Psychology/Revue Canadienne de Psychologie, 44(4), 522–545. https://doi.org/10.1037/h0084264
doi: 10.1037/h0084264
Reed, C. L., Shoman, S., & Halgren, E. (2004). Neural substrates of tactile object recognition: an fMRI study. Human Brain Mapping, 21(4), 236-246
Richler, J. J., Wilmer, J. B., & Gauthier, I. (2017). General object recognition is specific: Evidence from novel and familiar objects. Cognition, 166, 42–55. https://doi.org/10.1016/j.cognition.2017.05.019
doi: 10.1016/j.cognition.2017.05.019
pubmed: 28554084
Richler, J. J., Tomarken, A. J., Sunday, M. A., Vickery, T. J., Ryan, K. F., Floyd, R. J., Sheinberg, D., Wong, A.C.-N.-N., & Gauthier, I. (2019). Individual differences in object recognition. Psychological Review, 126(2), 226–251. https://doi.org/10.1037/rev0000129
doi: 10.1037/rev0000129
pubmed: 30802123
pmcid: 6484857
Russell, D. W., Kahn, J. H., Spoth, R., & Altmaier, E. M. (1998). Analyzing data from experimental studies: A latent variable structural equation modeling approach. Journal of Counseling Psychology, 45(1), 18–29. https://doi.org/10.1037/0022-0167.45.1.18
doi: 10.1037/0022-0167.45.1.18
Sathian, K., Lacey, S., Stilla, R., Gibson, G. O., Deshpande, G., Hu, X., LaConte, S., & Glielmi, C. (2011). Dual pathways for haptic and visual perception of spatial and texture information. NeuroImage, 57(2), 462–475. https://doi.org/10.1016/j.neuroimage.2011.05.001
doi: 10.1016/j.neuroimage.2011.05.001
pubmed: 21575727
Sathian, K., & Lacey, S. (2022). Cross-modal interactions of the tactile system. Current Directions in Psychological Science, 31(5). https://doi.org/10.1177/09637214221101877
Snow, J. C., Pettypiece, C. E., McAdam, T. D., McLean, A. D., Stroman, P. W., Goodale, M. A., & Culham, J. C. (2011). Bringing the real world into the fMRI scanner: Repetition effects for pictures versus real objects. Scientific Reports, 1(1), 130. https://doi.org/10.1038/srep00130
doi: 10.1038/srep00130
pubmed: 22355647
pmcid: 3216611
Snow, J. C., Skiba, R. M., Coleman, T. L., & Berryhill, M. E. (2014). Real-world objects are more memorable than photographs of objects. Frontiers in Human Neuroscience, 8. https://doi.org/10.3389/fnhum.2014.00837
Snow, J. C., Strother, L., & Humphreys, G. W. (2014b). Haptic Shape Processing in Visual Cortex. Journal of Cognitive Neuroscience, 26(5), 1154–1167. https://doi.org/10.1162/jocn_a_00548
doi: 10.1162/jocn_a_00548
pubmed: 24345179
Squires, S. D., Macdonald, S. N., Culham, J. C., & Snow, J. C. (2016). Priming tool actions: Are real objects more effective primes than pictures? Experimental Brain Research, 234(4), 963–976. https://doi.org/10.1007/s00221-015-4518-z
doi: 10.1007/s00221-015-4518-z
pubmed: 26686378
Sunday, M. A., Donnelly, E., & Gauthier, I. (2018). Both fluid intelligence and visual object recognition ability relate to nodule detection in chest radiographs. Applied Cognitive Psychology, 32(6), 755–762. https://doi.org/10.1002/acp.3460
doi: 10.1002/acp.3460
Sunday, M. A., Tomarken, A., Cho, S.-J., & Gauthier, I. (2022). Novel and familiar object recognition rely on the same ability. Journal of Experimental Psychology: General, 151(3), 676–694. https://doi.org/10.1037/xge0001100
doi: 10.1037/xge0001100
pubmed: 34582233
Tarr, M. J., Williams, P., Hayward, W. G., & Gauthier, I. (1998). Three-dimensional object recognition is viewpoint dependent. Nature Neuroscience, 1(4), 275–277. https://doi.org/10.1038/1089
doi: 10.1038/1089
pubmed: 10195159
Tomarken, A. J., & Waller, N. G. (2005). Structural equation modeling: Strengths, limitations, and misconceptions. Annual Review of Clinical Psychology, 1(1), 31–65. https://doi.org/10.1146/annurev.clinpsy.1.102803.144239
doi: 10.1146/annurev.clinpsy.1.102803.144239
pubmed: 17716081
Wang, M. W., & Stanley, J. C. (1970). Differential weighting: A review of methods and empirical studies. Review of Educational Research, 40(5), 663–705. https://doi.org/10.3102/00346543040005663
doi: 10.3102/00346543040005663
Wilmer, J. (2008). How to use individual differences to isolate functional organization, biology, and utility of visual functions; with illustrative proposals for stereopsis. Spatial Vision, 21(6), 561–579. https://doi.org/10.1163/156856808786451408
doi: 10.1163/156856808786451408
pubmed: 19017483
pmcid: 2586597
Wong, A.C.-N., Palmeri, T. J., Rogers, B. P., Gore, J. C., & Gauthier, I. (2009). Beyond shape: How you learn about objects affects how they are represented in visual cortex. PLOS ONE, 4(12), e8405. https://doi.org/10.1371/journal.pone.0008405
doi: 10.1371/journal.pone.0008405
pubmed: 20027229
pmcid: 2794531