Multimodal investigations of emotional face processing and social trait judgment of faces

doi:10.1111/nyas.15084

Paper

Multimodal investigations of emotional face processing and social trait judgment of faces

Published Nov 15, 2023 · Hongbo Yu, Chujun Lin, Sai Sun

Annals of the New York Academy of Sciences

Q1 SJR score

6

Citations

0

Influential Citations

PDF

Semantic Scholar

Abstract

Faces are among the most important visual stimuli that humans perceive in everyday life. While extensive literature has examined emotional processing and social evaluations of faces, most studies have examined either topic using unimodal approaches. In this review, we promote the use of multimodal cognitive neuroscience approaches to study these processes, using two lines of research as examples: ambiguity in facial expressions of emotion and social trait judgment of faces. In the first set of studies, we identified an event‐related potential that signals emotion ambiguity using electroencephalography and we found convergent neural responses to emotion ambiguity using functional neuroimaging and single‐neuron recordings. In the second set of studies, we discuss how different neuroimaging and personality‐dimensional approaches together provide new insights into social trait judgments of faces. In both sets of studies, we provide an in‐depth comparison between neurotypicals and people with autism spectrum disorder. We offer a computational account for the behavioral and neural markers of the different facial processing between the two groups. Finally, we suggest new practices for studying the emotional processing and social evaluations of faces. All data discussed in the case studies of this review are publicly available.

Literature Review

Study Snapshot

Key takeawayMultimodal cognitive neuroscience approaches can provide new insights into emotional face processing and social trait judgment of faces, comparing neurotypicals and those with autism spectrum disorder.

PopulationOlder adults (50-71 years)

Sample size24

MethodsObservational

OutcomesBody Mass Index projections

ResultsSocial networks mitigate obesity in older groups.

Sign up to use Study Snapshot

Consensus is limited without an account. Create an account or sign in to get more searches and use the Study Snapshot.

Create an account

Paper

Multimodal investigations of emotional face processing and social trait judgment of faces

Sign up to use Study Snapshot

References

Citations

Can micro-expressions be used as a biomarker for autism spectrum disorder?

Micro-expressions may have limited diagnostic value for autism spectrum disorder due to poor video data quality, highlighting the need for advancements in behavioral imaging and multimodal AI technology.

Video-based Analysis Reveals Atypical Social Gaze in People with Autism Spectrum Disorder

Third-person video perspectives can effectively analyze social gaze in people with autism spectrum disorder, potentially enhancing ASD diagnosis through gaze analysis.

Intelligent Framework for Predicting Autism Syndrome Disorder (ASD) Based on Hormonal Biomarkers: A Fuzzy Logic Approach

High levels of Serotonin and very low levels of Vitamin D and Melatonin significantly influence autism severity, while Oxytocin has no significant impact.

Atypical neural encoding of faces in individuals with autism spectrum disorder.

Individuals with autism spectrum disorder (ASD) show reduced specificity and increased inter-rater variability in social trait judgments, with atypical neural encoding of faces and altered facial saliency features.