Depth and direction effects in the prediction of static and shifted reaching goals from kinematics.
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
12 08 2023
12 08 2023
Historique:
received:
11
05
2023
accepted:
04
08
2023
medline:
16
8
2023
pubmed:
13
8
2023
entrez:
12
8
2023
Statut:
epublish
Résumé
The kinematic parameters of reach-to-grasp movements are modulated by action intentions. However, when an unexpected change in visual target goal during reaching execution occurs, it is still unknown whether the action intention changes with target goal modification and which is the temporal structure of the target goal prediction. We recorded the kinematics of the pointing finger and wrist during the execution of reaching movements in 23 naïve volunteers where the targets could be located at different directions and depths with respect to the body. During the movement execution, the targets could remain static for the entire duration of movement or shifted, with different timings, to another position. We performed temporal decoding of the final goals and of the intermediate trajectory from the past kinematics exploiting a recurrent neural network. We observed a progressive increase of the classification performance from the onset to the end of movement in both horizontal and sagittal dimensions, as well as in decoding shifted targets. The classification accuracy in decoding horizontal targets was higher than the classification accuracy of sagittal targets. These results are useful for establishing how human and artificial agents could take advantage from the observed kinematics to optimize their cooperation in three-dimensional space.
Identifiants
pubmed: 37573413
doi: 10.1038/s41598-023-40127-3
pii: 10.1038/s41598-023-40127-3
pmc: PMC10423273
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
13115Informations de copyright
© 2023. Springer Nature Limited.
Références
Jacob, P. & Jeannerod, M. The motor theory of social cognition: A critique. Trends Cogn. Sci. 9, 21–25 (2005).
doi: 10.1016/j.tics.2004.11.003
pubmed: 15639437
Kilner, J. More than one pathway to action understanding. Trends Cogn. Sci. 15, 352–357 (2011).
doi: 10.1016/j.tics.2011.06.005
pubmed: 21775191
pmcid: 3389781
Urgesi, C., Candidi, M. & Avenanti, A. Neuroanatomical substrates of action perception and understanding: An anatomic likelihood estimation meta-analysis of lesion-symptom mapping studies in brain injured patients. Front. Hum. Neurosci. 8, 344 (2014).
doi: 10.3389/fnhum.2014.00344
pubmed: 24910603
pmcid: 4039011
Egmose, I. & Køppe, S. Shaping of reach-to-grasp kinematics by intentions: A meta-analysis. J. Mot. Behav. 50, 155–165 (2018).
doi: 10.1080/00222895.2017.1327407
pubmed: 28644719
Jeannerod, M., Arbib, M. A., Rizzolatti, G. & Sakata, H. Grasping objects: The cortical mechanisms of visuomotor transformation. Trends Neurosci. 18, 314–320 (1995).
doi: 10.1016/0166-2236(95)93921-J
pubmed: 7571012
Manera, V., Becchio, C., Cavallo, A., Sartori, L. & Castiello, U. Cooperation or competition? Discriminating between social intentions by observing prehensile movements. Exp. Brain Res. 211, 547–556 (2011).
doi: 10.1007/s00221-011-2649-4
pubmed: 21465414
Sartori, L., Becchio, C. & Castiello, U. Cues to intention: The role of movement information. Cognition 119, 242–252 (2011).
doi: 10.1016/j.cognition.2011.01.014
pubmed: 21349505
Cavallo, A., Koul, A., Ansuini, C., Capozzi, F. & Becchio, C. Decoding intentions from movement kinematics. Sci. Rep. 6, 37036 (2016).
doi: 10.1038/srep37036
pubmed: 27845434
pmcid: 5109236
De Marco, D., Scalona, E., Bazzini, M. C., Avanzini, P. & Fabbri-Destro, M. Observer-agent kinematic similarity facilitates action intention decoding. Sci. Rep. 10, 2605 (2020).
doi: 10.1038/s41598-020-59176-z
pubmed: 32054915
pmcid: 7018748
Ansuini, C., Santello, M., Massaccesi, S. & Castiello, U. Effects of end-goal on hand shaping. J. Neurophysiol. 95, 2456–2465 (2006).
doi: 10.1152/jn.01107.2005
pubmed: 16381806
Becchio, C., Sartori, L., Bulgheroni, M. & Castiello, U. Both your intention and mine are reflected in the kinematics of my reach-to-grasp movement. Cognition 106, 894–912 (2008).
doi: 10.1016/j.cognition.2007.05.004
pubmed: 17585893
Ansuini, C., Giosa, L., Turella, L., Altoè, G. & Castiello, U. An object for an action, the same object for other actions: Effects on hand shaping. Exp. Brain Res. 185, 111–119 (2008).
doi: 10.1007/s00221-007-1136-4
pubmed: 17909766
Georgiou, I., Becchio, C., Glover, S. & Castiello, U. Different action patterns for cooperative and competitive behaviour. Cognition 102, 415–433 (2007).
doi: 10.1016/j.cognition.2006.01.008
pubmed: 16516188
Maselli, A. et al. Where are you throwing the ball? I better watch your body, not just your arm!. Front. Hum. Neurosci. https://doi.org/10.3389/fnhum.2017.00505 (2017).
doi: 10.3389/fnhum.2017.00505
pubmed: 29163094
pmcid: 5674933
Prablanc, C. & Martin, O. Automatic control during hand reaching at undetected two-dimensional target displacements. J. Neurophysiol. 67, 455–469 (1992).
doi: 10.1152/jn.1992.67.2.455
pubmed: 1569469
Soechting, J. F. & Lacquaniti, F. Modification of trajectory of a pointing movement in response to a change in target location. J. Neurophysiol. 49, 548–564 (1983).
doi: 10.1152/jn.1983.49.2.548
pubmed: 6834087
Brenner, E. & Smeets, J. B. J. Fast responses of the human hand to changes in target position. J. Mot. Behav. 29, 297–310 (1997).
doi: 10.1080/00222899709600017
pubmed: 12453772
Flanders, M., Tillery, S. I. H. & Soechting, J. F. Early stages in a sensorimotor transformation. Behav. Brain Sci. 15, 309–320 (1992).
doi: 10.1017/S0140525X00068813
Crawford, J. D., Henriques, D. Y. P. & Medendorp, W. P. Three-dimensional transformations for goal-directed action. Annu. Rev. Neurosci. 34, 309–331 (2011).
doi: 10.1146/annurev-neuro-061010-113749
pubmed: 21456958
Fabbri, S., Strnad, L., Caramazza, A. & Lingnau, A. Overlapping representations for grip type and reach direction. Neuroimage 94, 138–146 (2014).
doi: 10.1016/j.neuroimage.2014.03.017
pubmed: 24650596
De Vitis, M. et al. The neglected medial part of macaque area PE: Segregated processing of reach depth and direction. Brain Struct. Funct. 224, 2537–2557 (2019).
doi: 10.1007/s00429-019-01923-8
pubmed: 31327073
Filippini, M., Breveglieri, R., Hadjidimitrakis, K., Bosco, A. & Fattori, P. Prediction of reach goals in depth and direction from the parietal cortex. Cell Rep. 23, 725–732 (2018).
doi: 10.1016/j.celrep.2018.03.090
pubmed: 29669279
Collinger, J. L. et al. High-performance neuroprosthetic control by an individual with tetraplegia. Lancet 381, 557–564 (2013).
doi: 10.1016/S0140-6736(12)61816-9
pubmed: 23253623
pmcid: 3641862
Hochberg, L. et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature 485, 372–375 (2012).
doi: 10.1038/nature11076
pubmed: 22596161
pmcid: 3640850
Wallach, H. & Zuckerman, C. The constancy of stereoscopic depth. Am. J. Psychol. 76, 404–412 (1963).
doi: 10.2307/1419781
pubmed: 13998575
Cumming, B., Johnston, E. & Parker, A. Vertical disparities and perception of three-dimensional shape. Nature 349, 411–413 (1991).
doi: 10.1038/349411a0
pubmed: 1992341
Johnston, E. Systematic distortions of shape from stereopsis. Vis. Res. 31, 1351–1360 (1991).
doi: 10.1016/0042-6989(91)90056-B
pubmed: 1891823
Rogers, B. & Bradshaw, M. Vertical disparities, differential perspective and binocular stereopsis. Nature 361, 253–255 (1993).
doi: 10.1038/361253a0
pubmed: 8423851
Norman, J., Todd, J., Perotti, V. & Tittle, J. The visual perception of three-dimensional length. J. Exp. Psychol. Hum. Percept. Perform. 22, 173–186 (1996).
doi: 10.1037/0096-1523.22.1.173
pubmed: 8742260
Hibbard, P. & Bradshaw, M. Reaching for virtual objects: Binocular disparity and the control of prehension. Exp. Brain Res. 148, 196–201 (2003).
doi: 10.1007/s00221-002-1295-2
pubmed: 12520407
van Beers, R. J., Baraduc, P. & Wolpert, D. M. Role of uncertainty in sensorimotor control. Philos. Trans. R Soc. Lond. B Biol. Sci. 357, 1137–1145 (2002).
doi: 10.1098/rstb.2002.1101
pubmed: 12217180
pmcid: 1693018
Desmurget, M. & Grafton, S. Forward modeling allows feedback control for fast reaching movements. Trends Cognit. Sci. 4, 423–431. https://doi.org/10.1016/S1364-6613(00)01537-0 (2000).
doi: 10.1016/S1364-6613(00)01537-0
Komilis, E., Pelisson, D. & Prablanc, C. Error processing in pointing at randomly feedback-induced double-step stimuli. J. Mot. Behav. 25, 299–308 (1993).
doi: 10.1080/00222895.1993.9941651
pubmed: 15064196
Liu, D. & Todorov, E. Evidence for the flexible sensorimotor strategies predicted by optimal feedback control. J. Neurosci. 27, 9354–9368 (2007).
doi: 10.1523/JNEUROSCI.1110-06.2007
pubmed: 17728449
pmcid: 6673117
Brainard, D. H. The psychophysics toolbox. Spat. Vis. 10, 433–436 (1997).
doi: 10.1163/156856897X00357
pubmed: 9176952
Khan, M. A., Elliott, D., Coull, J., Chua, R. & Lyons, J. Optimal control strategies under different feedback schedules: Kinematic evidence. J. Mot. Behav. 34, 45–57 (2002).
doi: 10.1080/00222890209601930
pubmed: 11880249
Khan, M. A. et al. Online versus offline processing of visual feedback in the control of movement amplitude. Acta Psychol. (Amst) 113, 83–97 (2003).
doi: 10.1016/S0001-6918(02)00156-7
pubmed: 12679045
Bosco, A., Piserchia, V. & Fattori, P. Multiple coordinate systems and motor strategies for reaching movements when eye and hand are dissociated in depth and direction. Front. Hum. Neurosci. 11, 323 (2017).
doi: 10.3389/fnhum.2017.00323
pubmed: 28690504
pmcid: 5481402
Cho, K. et al. Learning Phrase Representations Using RNN Encoder–Decoder for Statistical Machine Translation. arXiv:1406.1078 (2014).
Kingma, D. & Ba, J. Adam: A Method for Stochastic Optimization. arXiv:1412.6980 (2017).