Mentalistic attention orienting triggered by android eyes.
Android
Attention orienting
Eyes
Gaze cueing paradigm
Mentalizing/theory of mind.
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
04 Oct 2024
04 Oct 2024
Historique:
received:
31
05
2024
accepted:
01
10
2024
medline:
5
10
2024
pubmed:
5
10
2024
entrez:
4
10
2024
Statut:
epublish
Résumé
The eyes play a special role in human communications. Previous psychological studies have reported reflexive attention orienting in response to another individual's eyes during live interactions. Although robots are expected to collaborate with humans in various social situations, it remains unclear whether robot eyes have the potential to trigger attention orienting similarly to human eyes, specifically based on mental attribution. We investigated this issue in a series of experiments using a live gaze-cueing paradigm with an android. In Experiment 1, the non-predictive cue was the eyes and head of an android placed in front of human participants. Light-emitting diodes in the periphery served as target signals. The reaction times (RTs) required to localize the valid cued targets were faster than those for invalid cued targets for both types of cues. In Experiment 2, the gaze direction of the android eyes changed before the peripheral target lights appeared with or without barriers that made the targets non-visible, such that the android did not attend to them. The RTs were faster for validly cued targets only when there were no barriers. In Experiment 3, the targets were changed from lights to sounds, which the android could attend to even in the presence of barriers. The RTs to the target sounds were faster with valid cues, irrespective of the presence of barriers. These results suggest that android eyes may automatically induce attention orienting in humans based on mental state attribution.
Identifiants
pubmed: 39367157
doi: 10.1038/s41598-024-75063-3
pii: 10.1038/s41598-024-75063-3
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
23143Informations de copyright
© 2024. The Author(s).
Références
McCarty, C. A. Eyes are the window to the soul. Clin. Exp. Ophthalmol. 39, 291–292 (2011).
pubmed: 21649808
doi: 10.1111/j.1442-9071.2011.02570.x
Kendon, A. Some functions of gaze-direction in social interaction. Acta Psychol. 26, 22–63 (1967).
doi: 10.1016/0001-6918(67)90005-4
Perrett, D. I., Hietanen, J. K., Oram, M. W. & Benson, P. J. Organization and functions of cells responsive to faces in the temporal cortex. Philos. Trans. R Soc. Lond. Biol. 335, 23–30 (1992).
pubmed: 1348133
doi: 10.1098/rstb.1992.0003
Kobayashi, H. & Kohshima, S. Unique morphology of the human eye. Nature. 387, 767–768 (1997).
pubmed: 9194557
doi: 10.1038/42842
Tomasello, M., Hare, B., Lehmann, H. & Call, J. Reliance on head versus eyes in the gaze following of great apes and human infants: the cooperative eye hypothesis. J. Hum. Evol. 52, 314–320 (2007).
pubmed: 17140637
doi: 10.1016/j.jhevol.2006.10.001
Friesen, C. K. & Kingstone, A. The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychon Bull. Rev. 5, 490–495 (1998).
doi: 10.3758/BF03208827
Driver, J. et al. Gaze perception triggers reflexive visuospatial orienting. Vis. Cogn. 6, 509–540 (1999).
doi: 10.1080/135062899394920
Dalmaso, M., Castelli, L. & Galfano, G. Social modulators of gaze-mediated orienting of attention: a review. Psychon Bull. Rev. 27, 833–855 (2020).
pubmed: 32291650
doi: 10.3758/s13423-020-01730-x
McKay, K. T. et al. Visual attentional orienting by eye gaze: a meta-analytic review of the gaze-cueing effect. Psychol. Bull. 147, 1269–1289 (2021).
pubmed: 35404635
doi: 10.1037/bul0000353
Posner, M. I. Orienting of attention. Q. J. Exp. Psychol. 32, 3–25 (1980).
pubmed: 7367577
doi: 10.1080/00335558008248231
Langton, S. R. H. & Bruce, V. Reflexive visual orienting in response to the social attention of others. Vis. Cogn. 6, 541–567 (1999).
doi: 10.1080/135062899394939
Newport, R. & Howarth, S. Social gaze cueing to auditory locations. Q. J. Exp. Psychol. 62, 625–634 (2009).
doi: 10.1080/17470210802486027
Sato, W., Okada, T. & Toichi, M. Attentional shift is triggered by gaze without awareness. Exp. Brain Res. 183, 87–94 (2007).
pubmed: 17624520
doi: 10.1007/s00221-007-1025-x
Xu, S., Zhang, S. & Geng, H. Gaze-induced joint attention persists under high perceptual load and does not depend on awareness. Vis. Res. 51, 2048–2056 (2011).
pubmed: 21840332
doi: 10.1016/j.visres.2011.07.023
Cole, G. G., Smith, D. T. & Atkinson, M. A. Mental state attribution and the gaze cueing effect. Atten. Percept. Psychophys. 77, 1105–1115 (2015).
pubmed: 25737252
doi: 10.3758/s13414-014-0780-6
Lachat, F., Conty, L., Hugueville, L. & George, N. Gaze cueing effect in a face-to-face situation. J. Nonverb Behav. 36, 177–190 (2012).
doi: 10.1007/s10919-012-0133-x
Kawai, N. Attentional shift by eye gaze requires joint attention: eye gaze cues are unique to shift attention. Jap Psychol. Res. 53, 292–301 (2011).
doi: 10.1111/j.1468-5884.2011.00470.x
Nuku, P. & Bekkering, H. Joint attention: inferring what others perceive (and don’t perceive). Conscious. Cogn. 17, 339–349 (2008).
pubmed: 17964811
doi: 10.1016/j.concog.2007.06.014
Schulz, J., Velichkovsky, B. M. & Helmert, J. R. Spontaneous adoption of the gaze cue’s perspective in a 3-d version of the noninformative gaze-cueing paradigm. Vis. Cogn. 22, 1–10 (2014).
doi: 10.1080/13506285.2013.864739
Teufel, C., Alexis, D. M., Clayton, N. S. & Davis, G. Mental-state attribution drives rapid, reflexive gaze following. Atten. Percept. Psychophysics. 72, 695–705 (2010).
doi: 10.3758/APP.72.3.695
Cole, G. G. & Millett, A. C. The closing of the theory of mind: a critique of perspective-taking. Psychon Bull. Rev. 26, 1787–1802 (2019).
pubmed: 31515733
doi: 10.3758/s13423-019-01657-y
Vishwakarma, L. P., Singh, R. K., Mishra, R., Demirkol, D. & Daim, T. The adoption of social robots in service operations: a comprehensive review. Technol. Soc. 76, 102441 (2024).
doi: 10.1016/j.techsoc.2023.102441
Bal, F., Tekerek, M., Palacz, M., Gök, M. & Şimşir, R. Human-robot interaction with social humanoid robots. J. Eng. Sci. 11, 94–102 (2024).
Chevalier, P., Kompatsiari, K., Ciardo, F. & Wykowska, A. Examining joint attention with the use of humanoid robots-A new approach to study fundamental mechanisms of social cognition. Psychon Bull. Rev. 27, 217–236 (2020).
pubmed: 31848909
doi: 10.3758/s13423-019-01689-4
Sato, W. et al. An android for emotional interaction: spatiotemporal validation of its facial expressions. Front. Psychol. 12, 800657 (2022).
pubmed: 35185697
pmcid: 8855677
doi: 10.3389/fpsyg.2021.800657
Wiese, E., Weis, P. & Lofaro, D. Embodied social robots trigger gaze following in real-time HRI. 15th International Conference on Ubiquitous Robots (UR) (2018). (2018).
Morillo-Mendez, L. et al. Can the robot see what I see? Robot gaze drives attention depending on mental state attribution. Front. Psychol. 14, 1215771 (2023).
pubmed: 37519379
pmcid: 10374202
doi: 10.3389/fpsyg.2023.1215771
Wykowska, A., Kajopoulos, J., Ramirez-Amaro, K. & Cheng, G. Autistic traits and sensitivity to human-like features of robot behavior. Interact. Stud. 16, 219–248 (2015).
doi: 10.1075/is.16.2.09wyk
Kompatsiari, K., Ciardo, F., Tikhanoff, V., Metta, G. & Wykowska, A. On the role of eye contact in gaze cueing. Sci. Rep. 8, 17842 (2018).
pubmed: 30552377
pmcid: 6294791
doi: 10.1038/s41598-018-36136-2
Kompatsiari, K., Ciardo, F., Tikhanoff, V., Metta, G. & Wykowska, A. It’s in the eyes: the engaging role of eye contact in HRI. Int. J. Social Robot. 13, 525–535 (2021).
doi: 10.1007/s12369-019-00565-4
Friebe, K., Samporová, S., Malinovská, K. & Hoffmann, M. Gaze cueing and the role of presence in human-robot interaction. International Conference on Social Robotics (2022).
Kompatsiari, K., Ciardo, F. & Wykowska, A. To follow or not to follow your gaze: the interplay between strategic control and the eye contact effect on gaze-induced attention orienting. J. Exp. Psychol. Gen. 151, 121–136 (2022).
pubmed: 34323536
doi: 10.1037/xge0001074
Foerster, F., Bailly, G. & Elisei, F. Impact of iris size and eyelids coupling on the estimation of the gaze direction of a robotic talking head by human viewers. 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids) (2015).
Hietanen, J. & Leppanen, J. M. Does facial expression affect attention orienting by gaze direction cues? J. Exp. Psychol. Hum. Percept. Perform. 29, 1228–1243 (2003).
pubmed: 14640840
doi: 10.1037/0096-1523.29.6.1228
Risko, E. F., Laidlaw, K., Freeth, M., Foulsham, T. & Kingstone, A. Social attention with real versus reel stimuli: toward an empirical approach to concerns about ecological validity. Front. Hum. Neurosci. 6, 143 (2012).
pubmed: 22654747
pmcid: 3360477
doi: 10.3389/fnhum.2012.00143
Ishiguro, H. & Nishio, S. Building artificial humans to understand humans. J. Artif. Organs. 10, 133–142 (2007).
pubmed: 17846711
doi: 10.1007/s10047-007-0381-4
Moser, E. et al. Amygdala activation at 3T in response to human and avatar facial expressions of emotions. J. Neurosci. Meth. 161, 126–133 (2007).
doi: 10.1016/j.jneumeth.2006.10.016
Schindler, S., Zell, E., Botsch, M. & Kissler, J. Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory. Sci. Rep. 7, 45003 (2017).
pubmed: 28332557
pmcid: 5362933
doi: 10.1038/srep45003
Ricciardelli, P., Carcagno, S., Vallar, G. & Bricolo, E. Is gaze following purely reflexive or goal-directed instead? Revisiting the automaticity of orienting attention by gaze cues. Exp. Brain Res. 224, 93–106 (2013).
pubmed: 23064809
doi: 10.1007/s00221-012-3291-5
Thellman, S., De Graaf, M. & Ziemke, T. Mental state attribution to robots: a systematic review of conceptions, methods, and findings. ACM Trans. Hum. -Robot Interact. 11, 1–51 (2022).
doi: 10.1145/3526112
Gray, H. M., Gray, K. & Wegner, D. M. Dimensions of mind perception. Science. 315, 619–619 (2007).
pubmed: 17272713
doi: 10.1126/science.1134475
Banks, J. Theory of mind in social robots: replication of five established human tests. Int. J. Soc. Robot. 12, 403–414 (2020).
doi: 10.1007/s12369-019-00588-x
Samson, D., Apperly, I. A., Braithwaite, J. J., Andrews, B. J. & Bodley Scott, S. E. Seeing it their way: evidence for rapid and involuntary computation of what other people see. J. Exp. Psychol. Hum. Percept. Perform. 36, 1255–1266 (2010).
pubmed: 20731512
doi: 10.1037/a0018729
Baron-Cohen, S. How to build a baby that can read minds: cognitive mechanisms in mindreading. Cah Psychol. Cogn. 13, 513–552 (1994).
Babinet, M. N., Cublier, M., Demily, C. & Michael, G. A. Eye direction detection and perception as premises of a social brain: a narrative review of behavioral and neural data. Cogn. Affect. Behav. Neurosci. 22, 1–20 (2022).
pubmed: 34642895
doi: 10.3758/s13415-021-00959-w
Sato, W. et al. Rapid gamma oscillations in the inferior occipital gyrus in response to eyes. Sci. Rep. 6, 36321 (2016).
pubmed: 27805017
pmcid: 5090864
doi: 10.1038/srep36321
McCarthy, G., Puce, A., Belger, A. & Allison, T. Electrophysiological studies of human face perception. II: response properties of face-specific potentials generated in occipitotemporal cortex. Cereb. Cortex. 9, 431–444 (1999).
pubmed: 10450889
doi: 10.1093/cercor/9.5.431
Emery, N. J. The eyes have it: the neuroethology, function and evolution of social gaze. Neurosci. Biobehav Rev. 24, 581–604 (2000).
pubmed: 10940436
doi: 10.1016/S0149-7634(00)00025-7
Takahashi, H. et al. Different impressions of other agents obtained through social interaction uniquely modulate dorsal and ventral pathway activities in the social human brain. Cortex. 58, 289–300 (2014).
pubmed: 24880954
doi: 10.1016/j.cortex.2014.03.011
Wu, S. & Keysar, B. The effect of culture on perspective taking. Psychol. Sci. 18, 600–606 (2007).
pubmed: 17614868
doi: 10.1111/j.1467-9280.2007.01946.x
Aival-Naveh, E., Rothschild-Yakar, L. & Kurman, J. Keeping culture in mind: a systematic review and initial conceptualization of mentalizing from a cross-cultural perspective. Clin. Psychol. 26, 25 (2019).
Faul, F., Erdfelder, E., Lang, A. G. & Buchner, A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods. 39, 175–191 (2007).
pubmed: 17695343
doi: 10.3758/BF03193146
Peirce, J. W. et al. PsychoPy2: experiments in behavior made easy. Behav. Res. Methods. 51, 195–203 (2019).
pubmed: 30734206
pmcid: 6420413
doi: 10.3758/s13428-018-01193-y
Uono, S., Sato, W. & Toichi, M. Dynamic fearful expressions enhance gaze-triggered attention orienting in high and low anxiety individuals. Soc. Behav. Pers. 37, 1313–1326 (2009).
doi: 10.2224/sbp.2009.37.10.1313
Uono, S., Sato, W. & Toichi, M. Dynamic fearful gaze does not enhance attention orienting in individuals with Asperger’s disorder. Brain Cogn. 71, 229–233 (2009).
pubmed: 19781841
doi: 10.1016/j.bandc.2009.08.015
Uono, S. et al. No influence of emotional faces or autistic traits on gaze-cueing in general population. Front. Psychol. 13, 864116 (2022).
pubmed: 35558687
pmcid: 9088812
doi: 10.3389/fpsyg.2022.864116
Uono, S. et al. Reduced gaze-cueing effect with neutral and emotional faces in adults with attention deficit/hyperactivity disorder. J. Psychiatr Res. 168, 310–317 (2023).
pubmed: 37949042
doi: 10.1016/j.jpsychires.2023.10.045
Glas, D. F., Minato, T., Ishi, C. T., Kawahara, T. & Ishiguro, H. E. R. I. C. A. The ERATO Intelligent Conversational Android. 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN (2016). (2016).
Team, J. A. S. P. JASP (Version 0.14.1). [Computer software] (2020).
Morey, R. D. Confidence Intervals from Normalized Data: A correction to Cousineau Tutor. Quant. Methods Psychol. 4, 61–64 2008. (2005).