This research was supported by grants MOST102-2410-H-001-044 and MOST103-2410-H-001-058-MY2 to M. Liou, and RSF-14-15-00202 to A.N. Savostyanov. The support of Russian Science Foundation (RSF) was used for elaboration of experimental paradigm of face recognition.

The authors have nothing to disclose.

The literature features studies on recognition of facial emotions in patients with autism by analysis of EEG reactions44, and on recognition of high- and low-spatial frequency contents using visual stimuli43. To the best of our knowledge, however, there is a lack of existing work on the brain oscillatory activity that combines emotion recognition with distinct spatial frequency contents. Our protocol is a first step towards estimating the influence of emotionality (positive, neutral and negative fac...

Facial emotion recognition is one of the most important brain processes engaged in social communications. A variety of mental disorders are related to problems with explicit detection of facial emotions4-6. A photograph of a face contains a spectrum of spatial information that can be filtered for either the high spatial frequency (HSF) or low spatial frequency (LSF) content. HSF is related to highly detailed parts of an image, such as the edges of a face, while LSF is related to coarser or less well-defined parts such as a holistic face with LSF contents7. Any face recognition task simultaneously induces conscious and non-conscious processes8-12, and the participation of the non-conscious process occurs in the 150-250 msec post onset interval or even earlier13. In healthy controls, the non-conscious process is generally faster than the conscious process14,15. Several neuroimaging studies have suggested that the LSF in a facial stimulus (or motivationally significant stimulus) mainly activates the amygdala, pulvinar, and superior colliculus especially with fearful faces3,16. These regions constitute the limbic structure in non-conscious perception of emotions and modulate cortical activity either directly or indirectly1. In contrast, conscious representation of emotions is more pronounced in the anterior cingulate, prefrontal cortex, and somatosensory cortex for directing voluntary attention to details in the face9,17,18.
Asperger&#39;s syndrome (AS)19,20 represents an atypical mental disturbance that affects sensory, affective and communicative abilities, without interfering with normal linguistic skills and intellectual ability. Several studies have found that functional deficits in the neural circuitry important for facial emotion recognition can partly explain the social communication failure in AS21-25. Behavioral disorders observed in children with AS can be diagnosed in the first three years of life26, a period during which their voluntary (or conscious) control over behaviors is not fully developed27. In adults with AS, the behavioral disorders can be compensated for through attention regulation28. Difficulty in processing details within a certain spatial frequency range may indicate a disruption in different information processing stages. So far, no study has directly addressed evoked potentials and oscillatory activity in patients with AS during facial emotion recognition involving face stimuli in specific spatial frequency ranges. It is important to examine the functional trajectory in patients with AS when compared with healthy controls during processing facial stimuli with different spatial frequency contents by controlling for task demands and demographic effects such as gender and IQ.
In order to clarify the interplay between conscious and non-conscious representations of emotional faces, an EEG experimental protocol is designed for comparing brain evoked potentials and oscillatory activity between patients with AS and IQ/gender-matched healthy controls. A cohort of pilot participants was recruited prior to the EEG experiment for assistance with selection of the experimental stimuli and development of a scoring system in order to facilitate an evaluation of performance in patients with AS. The protocol consists of two tasks involving emotionality evaluation of either photograph or line-drawing faces. The differences between the two groups can be assessed by computing ERPs and event-related spectral perturbations (ERSPs). In the next section, the details of the experimental protocol are elaborated on, including the pilot study and EEG data processing/analysis methods, followed by the main analysis results. Finally, the critical steps in the protocol and its significance with respect to existing methods are discussed. The limitation and possible extension of the protocol to use in patients with other emotional disorders are also pointed out.

<table><tbody><tr><td>Synamps 2/RT 128-channel EEG/EP/ERP</td><td>Neuroscan</td><td></td><td></td></tr><tr><td>Quik-CapEEG 128 electrodes</td><td>Neuroscan</td><td></td><td></td></tr><tr><td>Gel</td><td>Quik-Gel</td><td></td><td></td></tr><tr><td>FASTRAK 3D digitizer</td><td>Polhemus&amp;nbsp;</td><td></td><td></td></tr></tbody></table>

conscious and non-conscious representations of emotional faces in asperger's syndrome

Several neuroimaging studies have suggested that the low spatial frequency content in an emotional face mainly activates the amygdala, pulvinar, and superior colliculus especially with fearful faces1-3. These regions constitute the limbic structure in non-conscious perception of emotions and modulate cortical activity either directly or indirectly2. In contrast, the conscious representation of emotions is more pronounced in the anterior cingulate, prefrontal cortex, and somatosensory cortex for directing voluntary attention to details in faces3,4. Asperger&#39;s syndrome (AS)5,6 represents an atypical mental disturbance that affects sensory, affective and communicative abilities, without interfering with normal linguistic skills and intellectual ability. Several studies have found that functional deficits in the neural circuitry important for facial emotion recognition can partly explain social communication failure in patients with AS7-9. In order to clarify the interplay between conscious and non-conscious representations of emotional faces in AS, an EEG experimental protocol is designed with two tasks involving emotionality evaluation of either photograph or line-drawing faces. A pilot study is introduced for selecting face stimuli that minimize the differences in reaction times and scores assigned to facial emotions between the pretested patients with AS and IQ/gender-matched healthy controls. Information from the pretested patients was used to develop the scoring system used for the emotionality evaluation. Research into facial emotions and visual stimuli with different spatial frequency contents has reached discrepant findings depending on the demographic characteristics of participants and task demands2. The experimental protocol is intended to clarify deficits in patients with AS in processing emotional faces when compared with healthy controls by controlling for factors unrelated to recognition of facial emotions, such as task difficulty, IQ and gender.

The average verbal and performance IQ scores are listed in Table 1 for the control and AS groups along with the average reaction times and average scores assigned to emotionality of faces of the two groups. In the table, none of the group differences achieves statistical significance except for the neutral faces in the line-drawing task, where the AS group has an average score near zero (p &lt;0.001)13. Interestingly, the AS group still has slightly lo...

Watch this Scientific Journal Video about Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome at JoVE.com

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

An EEG experimental protocol is designed to clarify the interplay between conscious and non-conscious representations of emotional faces in patients with Asperger&#39;s syndrome. The technique suggests that patients with Asperger&#39;s syndrome have deficits in non-conscious representation of emotional faces, but have comparable performance in conscious representation with healthy controls.

Several neuroimaging studies have suggested that the low spatial frequency content in an emotional face mainly activates the amygdala, pulvinar, and ...

conscious-non-conscious-representations-emotional-faces-asperger-s

Research

JoVE Journal

Behavior

13.0K Views.  Academia Sinica.  Een EEG experimentele protocol is ontworpen om de wisselwerking tussen bewust en onbewust representaties van emotionele gezichten duidelijk bij patiënten met Asperger. De techniek suggereert dat patiënten met het syndroom van Asperger hebben tekorten in de niet-bewuste voorstelling van emotionele gezichten, maar hebben vergelijkbare prestaties in de bewuste voorstelling met gezonde controles. 

Video: Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Measurement of Fronto-limbic Activity Using an Emotional Oddball Task in Children with Familial High Risk for Schizophrenia

Adolescence is a critical developmental period where the early symptoms of schizophrenia frequently emerge. First-degree relatives of people with schizophrenia who are at familial high risk (FHR) may show similar cognitive and emotional changes. However, the neurological changes underlying the emergence of these symptoms remain unclear. This study sought to identify differences in frontal, striatal, and limbic regions in children and adolescents with FHR using functional magnetic resonance imaging. Groups of 21 children and adolescents at FHR and 21 healthy controls completed an emotional oddball task that relied on selective attention and the suppression of task-irrelevant emotional information. The standard oddball task was modified to include aversive and neutral distractors in order to examine potential group differences in both emotional and executive processing. This task was designed specifically to allow for children and adolescents to complete by keeping the difficulty and emotional image content age-appropriate. Furthermore, we demonstrate a technique for suitable fMRI registration for children and adolescent participants. This paradigm may also be applied in future studies to measure changes in neural activity in other populations with hypothesized developmental changes in executive and emotional processing.

This paper describes how to use the emotional oddball task and fMRI to measure brain activation in children and adolescents at familial high risk for schizophrenia (FHR).&#160;FMRI was used to measure differences in fronto-striato-limbic regions during an emotional oddball task. Children with FHR exhibited abnormal functional activation during adolescence.

Adolescence is a critical developmental period where the early symptoms of schizophrenia frequently emerge. First-degree relatives of people with ...

Brain Imaging Investigation of the Neural Correlates of Emotion Regulation

The ability to control/regulate emotions is an important coping mechanism in the face of emotionally stressful situations. Although significant progress has been made in understanding conscious/deliberate emotion regulation (ER), less is known about non-conscious/automatic ER and the associated neural correlates. This is in part due to the problems inherent in the unitary concepts of automatic and conscious processing1. Here, we present a protocol that allows investigation of the neural correlates of both deliberate and automatic ER using functional magnetic resonance imaging (fMRI). This protocol allows new avenues of inquiry into various aspects of ER. For instance, the experimental design allows manipulation of the goal to regulate emotion (conscious vs. non-conscious), as well as the intensity of the emotional challenge (high vs. low). Moreover, it allows investigation of both immediate (emotion perception) and long-term effects (emotional memory) of ER strategies on emotion processing. Therefore, this protocol may contribute to better understanding of the neural mechanisms of emotion regulation in healthy behaviour, and to gaining insight into possible causes of deficits in depression and anxiety disorders in which emotion dysregulation is often among the core debilitating features.

We present a protocol that allows investigation of the neural correlates of deliberate and automatic emotion regulation, using functional magnetic resonance imaging. This protocol can be used in healthy participants, both young and older, as well as in clinical patients.

The ability to control/regulate emotions is an important coping mechanism in the face of emotionally stressful situations. Although significant progress ...

Neuroscience

Brain Imaging Investigation of the Memory-Enhancing Effect of Emotion

Emotional events tend to be better remembered than non-emotional events1,2. One goal of cognitive and affective neuroscientists is 
to understand the neural mechanisms underlying this enhancing effect of emotion on memory. A method that has proven particularly influential in the 
investigation of the memory-enhancing effect of emotion is the so-called subsequent memory paradigm (SMP). This method was originally used to investigate the 
neural correlates of non-emotional memories3, and more recently we and others also applied it successfully to studies of emotional memory (reviewed in4, 5-7). 
Here, we describe a protocol that allows investigation of the neural correlates of the memory-enhancing effect of emotion using the SMP in conjunction with 
event-related functional magnetic resonance imaging (fMRI). An important feature of the SMP is that it allows separation of brain activity specifically 
associated with memory from more general activity associated with perception. Moreover, in the context of investigating the impact of emotional stimuli, 
SMP allows identification of brain regions whose activity is susceptible to emotional modulation of both general/perceptual and memory-specific processing. 
This protocol can be used in healthy subjects8-15, as well as in clinical patients where there are alterations in the neural correlates of emotion perception 
and biases in remembering emotional events, such as those suffering from depression and post-traumatic stress disorder (PTSD)16, 17.

We present a protocol that uses functional magnetic resonance imaging to investigate the neural correlates of the memory-enhancing effect of emotion. This protocol allows identification of brain activity specifically linked to memory-related processing, contrary to more general perceptual processing, and can be used with healthy and clinical populations.

Emotional events tend to be better remembered than non-emotional events1,2. One goal of cognitive and affective neuroscientists is 
to understand the ...

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

The current study presented 60 people with traumatic brain injury (TBI) and 60 controls with isolated facial emotion expressions, isolated vocal emotion expressions, and multimodal (i.e., film clips) stimuli that included contextual cues. All stimuli were presented via computer. Participants were required to indicate how the person in each stimulus was feeling using a forced-choice format. Additionally, for the film clips, participants had to indicate how they felt in response to the stimulus, and the level of intensity with which they experienced that emotion.

This paper describes how to implement a battery of behavioral tasks to examine emotion recognition of isolated facial and vocal emotion expressions, and a novel task using commercial television and film clips to assess multimodal emotion recognition that includes contextual cues.

The current study presented 60 people with traumatic brain injury (TBI) and 60 controls with isolated facial emotion expressions, isolated vocal emotion ...

Eye Tracking Young Children with Autism

The rise of accessible commercial eye-tracking systems has fueled a rapid increase in their use in psychological and psychiatric research. By providing a direct, detailed and objective measure of gaze behavior, eye-tracking has become a valuable tool for examining abnormal perceptual strategies in clinical populations and has been used to identify disorder-specific characteristics1, promote early identification2, and inform treatment3. In particular, investigators of autism spectrum disorders (ASD) have benefited from integrating eye-tracking into their research paradigms4-7. Eye-tracking has largely been used in these studies to reveal mechanisms underlying impaired task performance8 and abnormal brain functioning9, particularly during the processing of social information1,10-11. While older children and adults with ASD comprise the preponderance of research in this area, eye-tracking may be especially useful for studying young children with the disorder as it offers a non-invasive tool for assessing and quantifying early-emerging developmental abnormalities2,12-13. Implementing eye-tracking with young children with ASD, however, is associated with a number of unique challenges, including issues with compliant behavior resulting from specific task demands and disorder-related psychosocial considerations. In this protocol, we detail methodological considerations for optimizing research design, data acquisition and psychometric analysis while eye-tracking young children with ASD. The provided recommendations are also designed to be more broadly applicable for eye-tracking children with other developmental disabilities. By offering guidelines for best practices in these areas based upon lessons derived from our own work, we hope to help other investigators make sound research design and analysis choices while avoiding common pitfalls that can compromise data acquisition while eye-tracking young children with ASD or other developmental difficulties.

Eye tracking has long been used to study gaze patterns in typically-developing individuals, but recent technological advancements have made its use with clinical populations, including autism, more feasible. While eye-tracking young children with autism can offer insight into early symptom manifestations, it involves methodological challenges. Suggestions for best practices are provided.

The rise of accessible commercial eye-tracking systems has fueled a rapid increase in their use in psychological and psychiatric research. By providing a ...

Medicine

Comparing Eye-tracking Data of Children with High-functioning ASD, Comorbid ADHD, and of a Control Watching Social Videos

Children with autism spectrum disorders (ASD) are known to have sensory-perceptual processing deficits that weaken their abilities to attend and perceive social stimuli in daily living contexts. Since daily social episodes consist of subtle dynamic changes in social information, any failure to attend to or process subtle human nonverbal cues, such as facial expression, postures, and gestures, might lead to inappropriate social interaction. Traditional behavioral rating scales or assessment tools based on static social scenes have limitations in capturing the moment-to-moment changes in social scenarios. An eye-tracking assessment, which can be administered in a video-based mode, is therefore preferred, to augment clinical observation. In this study, using the single-case comparison design, the eye-tracking data of three participants, a child with autism spectrum disorder (ASD), another with comorbid attention deficit-hyperactive disorder (ADHD), and a neurotypical control, are captured while they view a video of social scenarios. The eye-tracking experiment has helped answer the research question: How does social attention differ between the three participants? By predefining areas of interest (AOIs), their visual attention on relevant or irrelevant social stimuli, how fast each participant attends to the first social stimuli appearing in the videos, for how long each participant continues to attend to those stimuli within the AOIs, and the gaze shifts between multiple social stimuli appearing concurrently in the same social scene are captured, compared, and analyzed in a video-based eye-tracking experiment.

This is a qualitative comparative case study analysis of eye-tracking data on the first moments of social video scenes as viewed by three participants: one with autism spectrum disorder, one with comorbid attention deficit-hyperactive disorder, and one neurotypical control.

Children with autism spectrum disorders (ASD) are known to have sensory-perceptual processing deficits that weaken their abilities to attend and perceive ...

Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans

"Affective" touch is believed to be processed in a manner distinct from discriminatory touch and to involve activation of C-tactile (CT) afferent fibers. Touch that optimally activates CT fibers is consistently rated as hedonically pleasant. Patient groups with impaired social-emotional functioning also show disordered affective touch ratings. However, relying on self-reported ratings of touch has many limitations, including recall bias and communication barriers. Here, we describe a methodological approach to study affective responses to touch via facial electromyography (EMG) that circumvents the reliance on self-report ratings. Facial EMG is an objective, quantitative, and non-invasive method to measure facial muscle activity indicative of affective responses. Responses can be assessed across healthy and patient populations without the need for verbal communication. Here, we provide two separate datasets demonstrating that CT-optimal and non-optimal touch elicit distinct facial muscle reactions. Moreover, facial EMG responses are consistent across stimulus modalities, e.g. tactile (experienced touch) and visual (observed touch). Finally, the temporal resolution of facial EMG can detect responses on timescales that supersede that of verbal reporting. Together, our data suggest that facial EMG is a suitable methodology for use in affective tactile research that can be used to supplement, or in some cases, supplant, existing measures.

We describe a protocol to assess facial muscle activity in response to experienced and observed tactile stimulation using facial electromyography.

"Affective" touch is believed to be processed in a manner distinct from discriminatory touch and to involve activation of C-tactile (CT) afferent fibers. ...

The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients

Many children with attention deficit hyperactive disorder (ADHD) are known to have executive dysfunction, which weakens their abilities to learn and behave in daily living. This protocol describes the methodology that is required for the intervention (psychotherapy) based on planning, attention, successive, and simultaneous (PASS theory) cognitive processing and fear emotional processing. It provides guiding principles and practical recommendations. A disproportionately high level of fear (dysregulation) increases the vulnerability for dysfunction in learning and behavior. We explain the interplay between emotion and cognition at the neurological level.
A go/no go task (The Adventures of Fundi), which involves decision making, is administered in a PC- mode to a sample of 66 ADHD subjects. The Adventures of Fundi, a computer program, was constructed to induce successive or simultaneous processing when involving the training of planning and selective attention. It aims to improve the executive function with planning and selective attention. If executive function improves, learning improves, and behavior ameliorates. After intervention over 6 months, remission was achieved in 70% of subjects.
The instructor encourages the use of appropriate strategies and points out the ways in which the strategies can be useful in finding the solution to the problem (go/no go). The emphasis is not on rehearsing and adult instructed verbal sequence. The verbalization may reveal the conscious verbalized strategy to solve a task that is not really the strategy being unconsciously used in that case. A self-verbal report is unreliable. This is an inductive learning rather than deductive rule-learning approach central to cognitive PASS training. This inductive training has proved to produce not only near transfer but also far transfer.
Noncognitive factors (emotional factors) must be considered to maximize the benefit of cognitive training. Indirect and metaphorical communication considers the emotional factor.

This protocol illustrates a remedial therapy based on inductive learning and indirect communication (Ericksonian metaphorical hypnosis) that can be applied to children with Attention Deficit Hyperactive Disorder (ADHD). Particularly, this protocol is intended to test the effectiveness of a go/no-go decision task. Neuroscientific rationale is presented throughout the text.

Many children with attention deficit hyperactive disorder (ADHD) are known to have executive dysfunction, which weakens their abilities to learn and ...

Exploring the Neural Correlates of Cognitive Reappraisal in Obsessive-Compulsive Disorder Using Task-based Functional Magnetic Resonance Imaging

Patients with obsessive-compulsive disorder (OCD) show heightened brain activity in limbic and orbitofrontal regions when confronted with negative emotions, which could be associated with impairments in emotion regulation skills. The ability to regulate emotions is a necessary coping mechanism when facing emotionally distressing situations, and deliberate emotion regulation strategies such as cognitive reappraisal have been extensively studied in the general population. Despite this, little is known about potential deliberate emotion regulation deficits in OCD patients and the associated neural correlates. Here, we describe a protocol to investigate the neural correlates of deliberate emotion regulation (cognitive reappraisal) using functional magnetic resonance imaging (fMRI) in OCD patients in comparison to a matched control sample. This protocol follows current gold standards for neuroimaging studies and includes both task activation and connectivity analysis (as well as behavioral data) to allow a more complete investigation. Therefore, we expect it will contribute to expanding the knowledge of the neural correlates of emotion (dys)regulation in OCD, and it could also be applied to explore emotion regulation deficits in other psychiatric disorders.

We introduce a protocol for exploring the neural correlates of a cognitive emotion regulation task, namely cognitive reappraisal, using functional magnetic resonance imaging. This protocol was used in patients with obsessive-compulsive disorder and healthy controls but can also be used in other clinical samples.

Patients with obsessive-compulsive disorder (OCD) show heightened brain activity in limbic and orbitofrontal regions when confronted with negative ...

Physiological Correlates of Emotion Recognition

Source: Laboratories of Jonas T. Kaplan and Sarah I. Gimbel&#8212;University of Southern California
The autonomic nervous system (ANS) controls the activity of the body's internal organs and regulates changes in their activity depending on the current environment. The vagus nerve, which innervates many of the internal organs, is an important part of the system. When our brain senses danger, vagal tone is inhibited, leading to a set of changes in the body designed to make us more prepared to fight or flee; for example, our heart rate increases, our pupils dilate, and we breath more quickly. Conversely, when the vagal system is activated, these physiological responses are inhibited, leading to a calmer state. The vagus nerve, then, acts as a kind of "brake" on our arousal. One interesting consequence of this calmer state is that it tends to promote social interaction-when we are not tensed and afraid of our immediate environment we are instead receptive to interacting with others. Poor functioning of this regulatory mechanism, therefore, may be associated with difficulties in social behavior.
One index of autonomic regulation is heart rate variability (HRV). HRV is a measure of how much the gap between one beat and the next varies over time. High HRV means there are continual fluctuations in the heart rate over time, a reflection of successful autonomic regulation. Low HRV means there is consistency of the heart rate over time, a condition associated with poor autonomic regulation. 
In this study we will test the hypothesis that increased HRV is associated with more accurate categorization of emotional stimuli.1,2 Following a study by Park et al., we will measure HRV and test its association on a task that measures skill at perceiving facial emotions.3

Correlating Heart Rate Variability with Emotion Recognition

Source: Laboratories of Jonas T. Kaplan and Sarah I. Gimbel&#8212;University of Southern California
The autonomic nervous system (ANS) controls the ...

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Samenvatting

Meer video's verkennen