An Honest Joker reveals stereotypical beliefs about the face of deception.
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
03 10 2023
03 10 2023
Historique:
received:
09
12
2022
accepted:
26
09
2023
medline:
5
10
2023
pubmed:
4
10
2023
entrez:
3
10
2023
Statut:
epublish
Résumé
Research on deception detection has mainly focused on Simple Deception, in which false information is presented as true. Relatively few studies have examined Sophisticated Deception, in which true information is presented as false. Because Sophisticated Deception incentivizes the appearance of dishonesty, it provides a window onto stereotypical beliefs about cues to deception. Here, we adapted the popular Joker Game to elicit spontaneous facial expressions under Simple Deception, Sophisticated Deception, and Plain Truth conditions, comparing facial behaviors in static, dynamic nonspeaking, and dynamic speaking presentations. Facial behaviors were analysed via machine learning using the Facial Action Coding System. Facial activations were more intense and longer lasting in the Sophisticated Deception condition than in the Simple Deception and Plain Truth conditions. More facial action units intensified in the static condition than in the dynamic speaking condition. Simple Deception involved leaked facial behaviors of which deceivers were unaware. In contrast, Sophisticated Deception involved deliberately leaked facial cues, including stereotypical cues to lying (e.g., gaze aversion). These stereotypes were inaccurate in the sense that they diverged from cues in the Simple Deception condition-the actual appearance of deception in this task. Our findings show that different modes of deception can be distinguished via facial action analysis. They also show that stereotypical beliefs concerning cues to deception can inform behavior. To facilitate future research on these topics, the multimodal stimuli developed in this study are available free for scientific use.
Identifiants
pubmed: 37789048
doi: 10.1038/s41598-023-43716-4
pii: 10.1038/s41598-023-43716-4
pmc: PMC10547800
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
16649Informations de copyright
© 2023. Springer Nature Limited.
Références
DePaulo, B. M., Kashy, D. A., Kirkendol, S. E., Wyer, M. M. & Epstein, J. A. Lying in everyday life. J. Pers. Soc. Psychol. 70, 979–995. https://doi.org/10.1037/0022-3514.70.5.979 (1996).
doi: 10.1037/0022-3514.70.5.979
pubmed: 8656340
Edelman, B. & Larkin, I. Social comparisons and deception across workplace hierarchies: Field and experimental evidence. Organ. Sci. 26, 78–98. https://doi.org/10.2139/ssrn.1346397 (2015).
doi: 10.2139/ssrn.1346397
Sutter, M. Deception through telling the truth?! Experimental evidence from individuals and teams. Econ. J. 119, 47–60. https://doi.org/10.1111/j.1468-0297.2008.02205.x (2009).
doi: 10.1111/j.1468-0297.2008.02205.x
Volz, K. G., Vogeley, K., Tittgemeyer, M., von Cramon, D. Y. & Sutter, M. The neural basis of deception in strategic interactions. Front. Behav. Neurosci. 9, 27. https://doi.org/10.3389/fnbeh.2015.00027 (2015).
doi: 10.3389/fnbeh.2015.00027
pubmed: 25729358
pmcid: 4325923
Ding, X. P., Sai, L., Fu, G., Liu, J. & Kang, L. Neural correlates of second-order verbal deception: A functional near-infrared spectroscopy (fNIRS) study. NeuroImage 87, 505–514. https://doi.org/10.1016/j.neuroimage.2013.10.023 (2014).
doi: 10.1016/j.neuroimage.2013.10.023
pubmed: 24161626
Zuckerman, M., DePaulo, B. M. & Rosenthal, R. Verbal and nonverbal communication of deception. In Advances in experimental social psychology (ed. Berkowitz, L.) 1–59 (Academic Press, 1981). https://doi.org/10.1016/S0065-2601(08)60369-X .
doi: 10.1016/S0065-2601(08)60369-X
Carrión, R. E., Keenan, J. P. & Sebanz, N. A truth that’s told with bad intent: An ERP study of deception. Cognition 114, 105–110. https://doi.org/10.1016/j.cognition.2009.05.014 (2010).
doi: 10.1016/j.cognition.2009.05.014
pubmed: 19836013
DePaulo, B. M. et al. Cues to deception. Psychol. Bull. 129, 74–118. https://doi.org/10.1037/0033-2909.129.1.74 (2003).
doi: 10.1037/0033-2909.129.1.74
pubmed: 12555795
Ekman, P. Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage (WW Norton & Company, 2009). https://doi.org/10.1080/00029157.2011.10404358 .
doi: 10.1080/00029157.2011.10404358
Ekman, P. & Friesen, W. V. Nonverbal leakage and clues to deception. Psychiatry 32, 88–106. https://doi.org/10.1080/00332747.1969.11023575 (1969).
doi: 10.1080/00332747.1969.11023575
pubmed: 5779090
Vrij, A. Detecting lies and deceit: Pitfalls and opportunities. Retrieved from http://books.google.com/books?hl=en&lr=&id=20pg76wmAucC&oi=fnd&pg=PR7&dq=A.+Vrij.+2008.+Detecting+lies+and+deceit:+Pitfalls+and+opportunities&ots=wdmrfkCidc&sig=Rmj4auTiHr2s9Lomo5ytytrj7QY#v=onepage&q&f=false (John Wiley & Sons, 2008).
Goldman-Eisler, F. Psycholinguistics: Experiments in Spontaneous Speech (Doubleday, 1968). https://doi.org/10.1016/0024-3841(70)90028-8 .
doi: 10.1016/0024-3841(70)90028-8
Ekman, P. & O’Sullivan, M. From flawed self-assessment to blatant whoppers: The utility of voluntary and involuntary behavior in detecting deception. Behav. Sci. Law. 24, 673–686. https://doi.org/10.1002/bsl.729 (2006).
doi: 10.1002/bsl.729
pubmed: 17016820
Hill, M. L. & Craig, K. D. Detecting deception in pain expressions: The structure of genuine and deceptive facial displays. Pain 98, 135–144. https://doi.org/10.1016/S0304-3959(02)00037-4 (2002).
doi: 10.1016/S0304-3959(02)00037-4
pubmed: 12098625
Frank, M. G., Ekman, P. & Friesen, W. V. Behavioral markers and recognizability of the smile of enjoyment. J. Pers. Soc. Psychol. 64, 83–93. https://doi.org/10.1037/0022-3514.64.1.83 (1993).
doi: 10.1037/0022-3514.64.1.83
pubmed: 8421253
Daft, R. L., Lengel, R. H. & Trevino, L. K. Message equivocality, media selection, and manager performance: implications for information systems. Mis. Quart. 11, 355–366. https://doi.org/10.2307/248682 (1987).
doi: 10.2307/248682
Carlson, J. R. & George, J. F. Media appropriateness in the conduct and discovery of deceptive communication: The relative influence of richness and synchronicity. Group Decis. Negot. 13, 191–210. https://doi.org/10.1023/B:GRUP.0000021841.01346.35 (2004).
doi: 10.1023/B:GRUP.0000021841.01346.35
Zhou, X. & Jenkins, R. Dunning-Kruger effects in face perception. Cognition 203, 104345. https://doi.org/10.1016/j.cognition.2020.104345 (2020).
doi: 10.1016/j.cognition.2020.104345
pubmed: 32531378
Scherer, K. R., Clark-Polner, E. & Mortillaro, M. In the eye of the beholder? Universality and cultural specificity in the expression and perception of emotion. Int. J. Psychol. 46, 401–435. https://doi.org/10.1080/00207594.2011.626049 (2011).
doi: 10.1080/00207594.2011.626049
pubmed: 22126090
Van Kleef, G. A. The interpersonal dynamics of emotion: Toward an integrative theory of emotions as social information (Cambridge University Press, 2016). https://doi.org/10.1017/CBO9781107261396.009 .
doi: 10.1017/CBO9781107261396.009
Proust, J. Metacognition and metarepresentation: Is a self- directed theory of mind a precondition for metacognition?. Synthese 159, 271–295. https://doi.org/10.1007/s11229-007-9208-3 (2007).
doi: 10.1007/s11229-007-9208-3
Baltrusaitis, T., Zadeh, A., Lim, Y. C. & Morency, L.-P. Openface 2.0: Facial behavior analysis toolkit. In 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition 59–66. https://doi.org/10.1109/FG.2018.00019 (2018).
Jaiswal, M., Tabibu, S. & Bajpai, R. The truth and nothing but the truth: multimodal analysis for deception detection. In 2016 IEEE 16th International Conference on Data Mining Workshops 938–943. https://doi.org/10.1109/ICDMW.2016.0137 (2016).
Belavadi, V. et al. MultiModal deception detection: Accuracy, applicability and generalizability. In 2020 Second IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications 99–106. https://doi.org/10.1109/TPS-ISA50397.2020.00023 (2020).
Islam, S., Saha, P., Chowdhury, T., Sorowar, A. & Rab, R. Non-invasive deception detection in videos using machine learning techniques. In 2021 5th International Conference on Electrical Engineering and Information Communication Technology 1–6. https://doi.org/10.1109/ICEEICT53905.2021.9667928 (2021).
Monaro, M., Maldera, S., Scarpazza, C., Sartori, G. & Navarin, N. Detecting deception through facial expressions in a dataset of videotaped interviews: A comparison between human judges and machine learning models. Comput. Hum. Behav. 127, 107063. https://doi.org/10.1016/j.chb.2021.107063 (2022).
doi: 10.1016/j.chb.2021.107063
Mondal, A., Mukhopadhyay, P., Basu, N., Bandyopadhyay, S. K. & Chatterjee, T. Quantitative analysis of euclidean distance to complement qualitative analysis of facial expression during deception. Ind. Psychiatry. J. 25, 78–85. https://doi.org/10.4103/0972-6748.196048 (2016).
doi: 10.4103/0972-6748.196048
pubmed: 28163412
pmcid: 5248424
Mondal, A., Mukhopadhyay, P., Basu, N., Bandyopadhyay, S. K. & Chatterjee, T. Identification of unique characteristics of deception from facial expression. Curr. Sci. 114, 901–906 (2018).
doi: 10.18520/cs/v114/i04/901-906
Larochette, A.-C., Chambers, C. T. & Craig, K. D. Genuine, suppressed and faked facial expressions of pain in children. Pain 126, 64–71. https://doi.org/10.1016/j.pain.2006.06.013 (2006).
doi: 10.1016/j.pain.2006.06.013
pubmed: 16860478
Faul, F., Erdfelder, E., Lang, A. G. & Buchner, A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39, 175–191. https://doi.org/10.3758/BF03193146 (2007).
doi: 10.3758/BF03193146
pubmed: 17695343
Noyes, E. & Jenkins, R. Deliberate disguise in face identification. J. Exp. Psychol. Appl. 25, 280–290. https://doi.org/10.1037/xap0000213 (2019).
doi: 10.1037/xap0000213
pubmed: 30730157
Beh, K. X. & Meng Goh, K. Micro-expression spotting using facial landmarks. In 2019 IEEE 15th International Colloquium on Signal Processing Its Applications 192–197. https://doi.org/10.1109/CSPA.2019.8696059 (2019).
Ekman, P. & Friesen, W. V. Facial action coding system: A technique for the measurement of facial movement (Consulting Psychologists Press, 1978). https://doi.org/10.1037/t27734-000 .
doi: 10.1037/t27734-000
Ekman, P. & Friesen, W. V. Felt, false, and miserable smiles. J. Nonverbal Behav. 6, 238–253. https://doi.org/10.1007/BF00987191 (1982).
doi: 10.1007/BF00987191
The Global Deception Research Team. A world of lies. J. Cross. Cult. Psychol. 37, 60–74. https://doi.org/10.1177/0022022105282295 (2006).
doi: 10.1177/0022022105282295
pmcid: 2957901
Delmas, H. et al. Policemen’s and civilians’ beliefs about facial cues of deception. J. Nonverbal Behav. 43, 59–90. https://doi.org/10.1007/s10919-018-0285-4 (2019).
doi: 10.1007/s10919-018-0285-4
Vrij, A. et al. Increasing cognitive load to facilitate lie detection: The benefit of recalling an event in reverse order. Law. Hum. Behav. 32, 253–265. https://doi.org/10.1007/s10979-007-9103-y (2008).
doi: 10.1007/s10979-007-9103-y
pubmed: 17694424
Du, S., Tao, Y. & Martinez, A. M. Compound facial expressions of emotion. Proc. Natl. Acad. Sci. 111, E1454–E1462. https://doi.org/10.1073/pnas.1322355111 (2014).
doi: 10.1073/pnas.1322355111
pubmed: 24706770
pmcid: 3992629
Stromwall, L. A., Granhag, P. A. & Hartwig, M. Practitioners’ beliefs about deception. In The detection of deception in forensic contexts (eds Granhag, P. A. & Stromwall, L. A.) 15–40 (Cambridge University Press, 2004). https://doi.org/10.1017/CBO9780511490071.010 .
doi: 10.1017/CBO9780511490071.010
Siegman, A. W. & Reynolds, M. A. Self-monitoring and speech feigned and unfeigned lying. J. Pers. Soc. Psychol. 45, 1325–1333. https://doi.org/10.1037/0022-3514.45.6.1325 (1983).
doi: 10.1037/0022-3514.45.6.1325
Bond, C. F. & DePaulo, B. M. Accuracy of deception judgments. Pers. Soc. Psychol. Rev. 10, 214–234. https://doi.org/10.1207/s15327957pspr1003_2 (2006).
doi: 10.1207/s15327957pspr1003_2
pubmed: 16859438