Multimodal investigations of emotional face processing and social trait judgment of faces

doi:10.1111/nyas.15084

Paper

Multimodal investigations of emotional face processing and social trait judgment of faces

Published Nov 15, 2023 · Hongbo Yu, Chujun Lin, Sai Sun

Annals of the New York Academy of Sciences

Q1 SJR score

6

Citations

0

Influential Citations

Full text Semantic Scholar

Abstract

Faces are among the most important visual stimuli that humans perceive in everyday life. While extensive literature has examined emotional processing and social evaluations of faces, most studies have examined either topic using unimodal approaches. In this review, we promote the use of multimodal cognitive neuroscience approaches to study these processes, using two lines of research as examples: ambiguity in facial expressions of emotion and social trait judgment of faces. In the first set of studies, we identified an event‐related potential that signals emotion ambiguity using electroencephalography and we found convergent neural responses to emotion ambiguity using functional neuroimaging and single‐neuron recordings. In the second set of studies, we discuss how different neuroimaging and personality‐dimensional approaches together provide new insights into social trait judgments of faces. In both sets of studies, we provide an in‐depth comparison between neurotypicals and people with autism spectrum disorder. We offer a computational account for the behavioral and neural markers of the different facial processing between the two groups. Finally, we suggest new practices for studying the emotional processing and social evaluations of faces. All data discussed in the case studies of this review are publicly available.

Study Snapshot

Key takeawayMultimodal cognitive neuroscience approaches can provide new insights into emotional face processing and social trait judgment of faces, comparing neurotypicals and those with autism spectrum disorder.

PopulationOlder adults (50-71 years)

Sample size24

MethodsObservational

OutcomesBody Mass Index projections

ResultsSocial networks mitigate obesity in older groups.

Sign up to use Study Snapshot

Consensus is limited without an account. Create an account or sign in to get more searches and use the Study Snapshot.

Create an account

Paper

Multimodal investigations of emotional face processing and social trait judgment of faces

Sign up to use Study Snapshot

References

Comprehensive Social Trait Judgments From Faces in Autism Spectrum Disorder

Individuals with autism spectrum disorder (ASD) show different judgments and reduced specificity in social trait judgments from faces compared to neurotypical individuals, driven by specific face types and differential use of features.

Functional connectivity between the amygdala and prefrontal cortex underlies processing of emotion ambiguity

The amygdala and prefrontal cortex work together to process emotion ambiguity in facial expressions, with abnormal connectivity potentially contributing to neuropsychiatric symptoms.

Personality Across World Regions Predicts Variability in the Structure of Face Impressions

People form face impressions based on their understanding of personality structure learned from their regional environment, highlighting the need for greater attention to regional and cultural specificity in face impression research.

Little Between-Region and Between-Country Variance When People Form Impressions of Others

Perceiver's first impressions of others are largely influenced by their individual characteristics and local environment, rather than their cultural background.

Review: Posed vs. Genuine Facial Emotion Recognition and Expression in Autism and Implications for Intervention

A facial emotion recognition teaching hierarchy (FERTH) can improve facial emotion recognition and expression in individuals with autism spectrum disorder (ASD).

Citations

Can micro-expressions be used as a biomarker for autism spectrum disorder?

Micro-expressions may have limited diagnostic value for autism spectrum disorder due to poor video data quality, highlighting the need for advancements in behavioral imaging and multimodal AI technology.

Video-based Analysis Reveals Atypical Social Gaze in People with Autism Spectrum Disorder

Third-person video perspectives can effectively analyze social gaze in people with autism spectrum disorder, potentially enhancing ASD diagnosis through gaze analysis.

Intelligent Framework for Predicting Autism Syndrome Disorder (ASD) Based on Hormonal Biomarkers: A Fuzzy Logic Approach

High levels of Serotonin and very low levels of Vitamin D and Melatonin significantly influence autism severity, while Oxytocin has no significant impact.

Atypical neural encoding of faces in individuals with autism spectrum disorder.

Individuals with autism spectrum disorder (ASD) show reduced specificity and increased inter-rater variability in social trait judgments, with atypical neural encoding of faces and altered facial saliency features.