Scholarly article on topic 'No Differences in Emotion Recognition Strategies in Children with Autism Spectrum Disorder: Evidence from Hybrid Faces'

No Differences in Emotion Recognition Strategies in Children with Autism Spectrum Disorder: Evidence from Hybrid Faces Academic research paper on "Psychology"

Share paper
Academic journal
Autism Research and Treatment
OECD Field of science

Academic research paper on topic "No Differences in Emotion Recognition Strategies in Children with Autism Spectrum Disorder: Evidence from Hybrid Faces"

Hindawi Publishing Corporation Autism Research and Treatment Volume 2014, Article ID 345878, 8 pages

Research Article

No Differences in Emotion Recognition Strategies in Children with Autism Spectrum Disorder: Evidence from Hybrid Faces

Kris Evers,1,2,3 Inneke Kerkhof,4 Jean Steyaert,2,3,5 Ilse Noens,3,6,7 and Johan Wagemans1,3

1 Laboratory of Experimental Psychology, KU Leuven, Tiensestraat 102 (Box 3711), 3000 Leuven, Belgium

2 Department of Child Psychiatry, UPC-KU Leuven, 3000 Leuven, Belgium

3 Leuven Autism Research (LAuRes), KU Leuven, 3000 Leuven, Belgium

4 Quantitative Psychology and Individual Differences, KU Leuven, 3000 Leuven, Belgium

5 Department of Clinical Genetics, University Hospital Maastricht, 6200 Maastricht, The Netherlands

6 Parenting and Special Education Research Unit, KU Leuven, 3000 Leuven, Belgium

7Psychiatric and Neurodevelopmental Genetics Unit, Massachusetts General Hospital, MA, Boston, USA

Correspondence should be addressed to Kris Evers;

Received 28 June 2013; Revised 24 November 2013; Accepted 2 December 2013; Published 5 January 2014

Academic Editor: Connie Kasari

Copyright © 2014 Kris Evers et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Emotion recognition problems are frequently reported in individuals with an autism spectrum disorder (ASD). However, this research area is characterized by inconsistent findings, with atypical emotion processing strategies possibly contributing to existing contradictions. In addition, an attenuated saliency of the eyes region is often demonstrated in ASD during face identity processing. We wanted to compare reliance on mouth versus eyes information in children with and without ASD, using hybrid facial expressions. A group of six-to-eight-year-old boys with ASD and an age- and intelligence-matched typically developing (TD) group without intellectual disability performed an emotion labelling task with hybrid facial expressions. Five static expressions were used: one neutral expression and four emotional expressions, namely, anger, fear, happiness, and sadness. Hybrid faces were created, consisting of an emotional face half (upper or lower face region) with the other face half showing a neutral expression. Results showed no emotion recognition problem in ASD. Moreover, we provided evidence for the existence of top- and bottom-emotions in children: correct identification of expressions mainly depends on information in the eyes (so-called top-emotions: happiness) or in the mouth region (so-called bottom-emotions: sadness, anger, and fear). No stronger reliance on mouth information was found in children with ASD.

1. Introduction

Facial expressions inform us about the feelings and state of mind of others and enable us to adjust our behavior and to react appropriately. Therefore, the ability to interpret facial expressions accurately and to derive socially relevant information from them is considered a fundamental requirement for typical reciprocal social interactions and communication [1].

Autism spectrum disorders (ASD) are pervasive developmental disorders characterized by quantitative and qualitative deficits in reciprocal social interactions and communication and by the presence of restricted and repetitive behavior patterns, interests, and activities [2]. Difficulties in

recognizing, identifying, and understanding the meaning of emotions are often considered as one of the trademarks of their social problems. Different procedures have been used to examine emotion processing abilities in children and adults with ASD, with or without intellectual disability: sorting, (cross-modal) matching, and labeling tasks (for a literature review and a meta-analysis on this topic, see [3, 4], resp.). Each of these procedures has revealed problems with affect processing in individuals with ASD (e.g., [5-8]). Other studies, however, failed to find atypical emotion recognition skills in individuals with ASD (e.g., [9-13]). Inconsistencies (for an overview, see [3]) may be due to differences in sample and participants' characteristics, task demands [14], and stimuli. Performances of individuals with ASD seem to be especially

impaired for negative, more subtle, or more complex emotions (e.g., [7, 15, 16]) or expressions embedded in a social context [17, 18]. Besides, it is important to note that an intact performance does not exclude the use of atypical-more cognition- or language-mediated—or more feature-based emotion processing strategies leading to impairments in some emotion recognition tasks, but camouflaging these deficits in other tasks (and therefore often referred to as compensation mechanisms; [3,11,19]).

Interestingly, face identity research has provided evidence for atypical face processing strategies in individuals with ASD (for a review, see [20]). People with ASD show an attenuated reliance on the eyes region: they are less attentive towards the upper face part in comparison to neurotypicals, but instead the lower face seems to be more salient. This was found using face identification tasks with familiar [21] and unfamiliar faces (e.g., [22, 23]) and with eye-movement studies using neutral faces or faces embedded in a social context (e.g., [24, 25]). This atypical attention pattern with an increased "mouth bias" in ASD was sometimes interpreted as a specific expertise for mouth regions [26], or as a (language-and-cognition mediated) compensation strategy [27], or even as an active aversion for the quickly and unpredictably moving eyes [28]. However, not all studies found differences in gaze patterns between children with and without ASD (e.g., [29, 30]). Here also, inconsistencies are supposed to be caused by differences in samples, tasks, and stimuli [3].

The above-mentioned studies concern facial identity processing. It is sometimes suggested that face identity recognition (which is based on invariant face properties) and face expression recognition (which is based on changeable aspects of a face) can be dissociated at a neural and theoretical level [31, 32]. According to this view, findings about face identity processing will not necessarily generalize to the domain of emotion perception (see also findings on patients with amyg-dalectomy [33] or acquired prosopagnosia [34]). The aim of the present study is to examine whether the atypical saliency of upper versus lower face area also holds for emotion perception in children with ASD.

Attendance to a narrow range of specific features in the face (e.g., the mouth region) when judging facial affect could partly explain the difficulties that children with ASD experience in reading emotional expressions. Some evidence for increased reliance on mouth information and less sensitivity for the eyes was already found ([16, 27, 35, 36], but also see, e.g., [37]). A disturbed attention pattern might affect emotion recognition performance most strongly in emotions where information of the eyes is more crucial. Research in typical individuals provided evidence for a distinction between top-emotions (most salient information in the eyes region) and bottom-emotions (most salient information in the mouth region). Behavioral research in adults demonstrated that the recognition of sadness, anger, and fear mostly relies on information in the eyes region, and the recognition of happiness and disgust relies on information in the mouth region ([38], Experiment 1). More recently, eye-movement studies also demonstrated that the most characteristic face regions (top or bottom) depend on nature of the emotional expression [39-41].

Figure 1: Representative sample stimulus of bottom-emotion happiness (a) and top-emotion fear (b), from left to right: original expression, hybrid expression with neutral mouth, and hybrid expression with neutral eyes (the pictures used in our paper are part of the California Facial Expression database, which is freely available online for research purpose. For more information regarding this database, we refer you to their website: readme.txt).

Using an emotion labeling task with hybrid stimuli, we wanted to compare the reliance on eyes versus mouth information in children with and without ASD when recognizing emotional expressions. Hence the original expressions of anger, fear, happiness, and sadness and neutral expressions were shown together with their hybrid counterparts. The hybrid facial expressions used here are computer-morphed emotional expressions with the upper (or lower) face half being replaced by a neutral expression, such that emotional information is only available in the mouth (or eyes, resp.) region (see Figure 1 for an example). The generation of hybrid facial stimuli is a rather novel technique with some significant benefits in comparison to eye-movement studies. Whereas both methods aim at evaluating automatic and implicit emotion recognition strategies, the most salient advantage of hybrid stimuli is a practical one. An expensive eye-tracking setup is obviously not required, making the experimental design easier to implement, and also significantly reduces the burden on participants. The data obtained within the context of an eye-movement experiment are clearly richer, yet much more difficult and less clear-cut to process. In addition to these more pragmatic advantages of using hybrid stimuli, an important methodological difference is the active manipulation of available information in hybrid expressions. Showing full facial expressions allows participants to (freely) scan the whole picture. However, this is impossible when using hybrid expressions, simply because no all emotional information is

Table 1: Demographic characteristics of both participant groups: means (M) and standard deviations (SD) for age (expressed in months), full-scale IQ, and ADI-R scores. Group differences in age or IQ were evaluated with independent samples i-tests (homoscedasticity assumption checked with F-test).

ASD group (n = 22) Comparison group (n = 22) Group comparison

M (SD) Range M (SD) Range 2-sided i-test P value

Age 92.14 (10.54) 75-106 95.36 (8.16) 79-107 1.11 .2483

Full-scale IQ 94.36 (11.93) 78-119 98.50 (7.78) 84-108 1.39 .1816

ADI-R scores 44.50 (12.59) 15-65 N/A N/A N/A

Communication 15.68 (5.27) 3-24

Social 20.45 (5.63) 8-28

Repetitive behaviors 5.41 (2.65) 1-9

available. Clearly, both paradigms offer a slightly different perspective on the evaluation of saliency of upper versus lower facial areas. Eye-movement studies indeed provide a stronger indication of spontaneous viewing strategies, but the drawback is that participants can adapt their viewing style, with both strategies being impossible to disentangle. Hybrid facial expressions, on the other hand, offer the opportunity to evaluate the reliance on a specific face half when recognizing emotions, by comparing performances on full expressions and their hybrid counterparts. Studies using face parts, such as, for instance, the part-whole paradigm or composite face illusions, also actively intervene in the available information. However, the lack of naturalness is a major disadvantage of using face parts. The processing of these nonfacial and artificial stimuli might be unnatural anyway, not telling us much about (full) face perception.

This study had two goals. We firstly wanted to evaluate whether children with ASD would experience difficulties when labeling four basic emotional expressions and a neutral expression. Secondly, we aimed at comparing eyes versus mouth reliance between children with and without ASD. If typically developing children mostly relied on information in the eyes region, they were expected to experience more difficulties recognizing a hybrid expression with neutral eyes, and especially for those emotions with more characteristic features in the eyes region (top-emotions), such as fear, anger, and sadness. An attenuated bias for the eyes region in the ASD group, or in increased reliance on the mouth area, would result in the reverse pattern. The ASD sample would then be mostly impaired when recognizing hybrid expressions with neutral mouths, and especially for bottom-emotions which have more salient features in the mouth area, such as happiness.

2. Methods

2.1. Participants. Two groups of six-to-eight-year-old boys without an intellectual disability (IQ > 70) participated in this study: an experimental group and a matched comparison group. The experimental group consisted of 22 boys with ASD, recruited through the child psychiatry unit at the university hospital (n = 16) and through a special needs school for children with ASD (n = 6). They all received a formal clinical diagnosis of ASD based on a comprehensive assessment by a multidisciplinary team (first subgroup) or by

a medical specialist (second subgroup), and according to DSM-IV-TR criteria [2]. Clinical diagnoses were confirmed within the research protocol using the Autism Diagnostic Interview-Revised (ADI-R; [42]) and by file review by a child psychiatrist experienced in ASD. Whereas all diagnoses were confirmed based on file review, all but two participants scored above cut-off on the reciprocal social interactions and the language/communication ADI-R domains. Four additional patients did not meet the restrictive and repetitive behaviors ADI-R domain. In the ASD group, full-scale IQ was measured within the recent clinical diagnostic protocol using the Wechsler Scales of Intelligence (WISC-III-R; [43]) or the Snijders-OomenNon-Verbal Intelligence Test (SON-R; [44]).

The comparison group comprised 22 typically developing boys (TD group), representative for the general population, and recruited through two mainstream schools. Within the experimental protocol, full-scale IQ was estimated based on an abbreviated version of the WISC-III-R [45], comprising four subtests (vocabulary, similarities, picture arrangement, and block design). The ASD and TD groups were groupwise matched based on age and full-scale IQ (for detailed participant characteristics and group comparisons, see Table 1).

2.2. Materials. Black-and-white photographs of twelve adult faces (seven males and five females) were selected from the California Facial Expressions database [46]. These stimuli were posed according to the Facial Action Coding System (FACS; [47]) and were normalized for the location of eyes and mouth. Hybrid facial expressions were created with Adobe Photoshop. In a hybrid expression, the upper (or lower) face part is replaced by a neutral upper (or lower) face of the same actor. For every emotion-identity combination, two types of hybrid expressions were made: one in which the upper part was replaced by a neutral expression ("hybrid with neutral eyes") and one in which the lower part was replaced by a neutral expression ("hybrid with neutral mouth"). The clone sample tool was used as smoothing tool to mask the lines between both face halves (see Figure 1 for an example).

Five different facial expressions were used: one neutral expression and four emotional faces, expressing happiness, sadness, anger, and fear. Based upon a pilot study (with six TD children and eight TD adults), the three (out of four) best recognizable emotions were selected for every actor, in such a way that, in total, all emotional expressions were presented

the same number of times (i.e., all four emotions were presented nine times).

2.3. Procedure and Design. Approval by the Medical Ethical Committee of the University Hospital was obtained and the participants' parents gave their written informed consent before start. All participants were tested individually in a quiet room. Stimuli were presented on a portable computer with a 38 cm screen, at a viewing distance of approximately 76 cm. Stimuli were presented within the E-prime environment. The experimental procedure followed a step-by-step protocol, including a phase wherein participants were made familiar with the different response alternatives and their understanding of the (emotion) labels was checked. This was done by asking for an example situation for the different emotions. If participants could not provide a correct example situation, the experimenter presented a standard example, as outlined in the protocol. Children were instructed to label the facial expressions. All participants understood the task and the emotion labels. Trials consisted of a face stimulus (presented at the left side) and the response alternatives (presented at the right side). Participants responded verbally or by pointing to the label at the screen. Experimenters always entered the participant's response. In between two trials a blank screen with fixation cross was presented for one second. The face stimuli were presented with an unlimited presentation time.

In total, this experiment consisted of 120 trials, so that each expression was presented 10 times per identity: 12 neutral facial expressions (1 per identity) + 36 original emotional expressions (3 emotions x 12 identities) + 72 hybrid emotional expressions (3 emotions x 12 identities x 2 hybrid types, namely, neutral mouth and neutral eyes). Trial order was randomized.

2.4. Data and Data Analysis. All analyses were performed with SAS. Split-plot ANOVAs were conducted on accuracy scores. Accuracy data for the original expressions were analyzed separately, with group (ASD-TD group) as between-subjects factor and expression (neutral-happiness-sadness-anger-fear) as within-subjects factor. In a second analysis, all versions, the hybrid and the original expressions, were analyzed, with the neutral expressions being omitted from these analyses because they had no hybrid counterpart. Again, a split-plot ANOVA with group (ASD-TD group) as between-subjects factor and emotional expression (happiness-sadness-anger-fear) and hybrid type (hybrid neutral mouth-hybrid neutral eyes-original emotional expression) as within-subjects factors was conducted for accuracy data. A significance level of P < .05 (two-sided) was adopted, and effects with a P value between .05 and .10 were indicated as marginally significant.

All analyses performed on the whole ASD group (n = 22) yielded similar results as analyses with the subgroup of ASD participants who scored above the cut-off on the social and communication domain of the ADI-R (n = 20), or on those participants who scored above cut-off on all ADI-R domains (n = 16). Therefore, we will report the results of the analyses on the whole group.

Table 2: Accurate labeling of the expressions for both participant groups: mean accuracy and standard deviation (between brackets).


Anger .71 (.22) .67 (.26)

Fear .76 (.21) .75 (.21)

Happiness .92 (.11) .98 (.04)

Neutral .60 (.31) .76 (.13)

Sadness .52 (.23) .56 (.26)

Anger Fear Happiness Neutral Sadness

□ ASD ■ TD

Figure 2: Mean performances for both participant groups on the different original expressions (error bars represent 95% confidence intervals of the means).

3. Results

3.1. Recognition of the Original Expressions and Relationship with Age, Full-Scale IQ, orASD Severity. Results (see Table 2) indicated a main effect of expression (F(4,168) = 27.28, P < .0001, see Figure 2). Post hoc Tukey-Kramer tests (a = .05) revealed that sadness (M = .54) was overall recognized less accurately than all other emotions, and happiness (M = .95) was overall recognized more accurately than all other emotions. We did not find evidence for a main effect of participant group (F(1,42) = 1.14, P = .29) and the participant group-by-expression-interaction was not significant either (F(4,168) = 1.69, P = .15).

No evidence for a correlation between emotion recognition and age, intelligence, or ASD traits (measured with the ADI-R) was found (all correlations with P values > .10).

3.2. Which Face Region Is Used to Recognize Emotional Expressions: Mouth or Eyes? Again, sadness was recognized less accurately (across group and hybrid type) than the other expressions, and happiness was the best recognized emotion (F(3,126) = 34.35, P < .0001; post-hoc Tukey-Kramer tests). Evidence for a main effect of hybrid type was also found (F(2,84) = 78.14, P < .0001), such that original stimuli were recognized the most accurate, and hybrid expressions with neutral eyes were recognized the least accurate. Interestingly,

Happiness Sadness

C Neutral eyes C Neutral mouth □ Original expression

S 0.6-

Happiness Sadness

C Neutral eyes C Neutral mouth □ Original expression

Figure 3: The effect of stimulus presentation (hybrid expression with neutral eyes, hybrid expression with neutral mouth, and original expression) on emotion recognition performance was similar in both the ASD group (a) and in the TD group (b). Happiness is a bottomemotion; sadness, anger, and fear are top-emotions. Error bars represent 95% confidence intervals of the means.

the interaction between emotion and hybrid type was highly significant (F(6,252) = 57.28, P < .0001), indicating that the most characteristic region (eyes or mouth) is emotion-dependent. Post hoc Bonferroni adjusted tests supported the distinction between top-emotions (anger, fear, and sadness) and bottom-emotions (happiness). Moreover, these tests indicated that adding the other, less characteristic face half did not significantly improve the performance (i.e., no statistically significant difference between the recognition of original expressions and the most salient hybrid ones).

The main effect of participant group was not significant (F(1,42) = 2.31, P = .14), nor were the interactions between participant group and emotion, or between participant group and hybrid type (all F < 1). Contrary to our expectations, the 3-way interaction among participant group, emotion, and hybrid type was not significant (F(6,252) = 1.59, P = .15, depicted in Figure 3 and Table 3). This suggests that both children with and without ASD show a similar distinction between expressions for which the mouth region contains the most salient information (bottom-emotions) and expressions for which the eyes region is the most informative (top-emotions).

4. Discussion

The goal of this research was to investigate (1) whether children with ASD were impaired in recognizing facial expressions of four basic emotions and a neutral one and (2) whether children with ASD tend to rely more on features in the lower part of the face (mouth region) when recognizing emotions. We evaluated this with a novel stimulus generation technique, namely, hybrid expressions, hereby actively manipulating the amount of emotional information available in the face stimulus. A computer-morphed facial expression was generated, with the upper (or lower) face half being replaced by a neutral expression, such that emotional

Table 3: Accurate labeling of the hybrid expressions for both participant groups: mean accuracy and standard deviation (between brackets).

Emotion Hybrid type ASD TD

Neutral eyes .18 (.18) .26 (.29)

Anger Neutral mouth .62 (.21) .74 (.13)

Original .71 (.22) .67 (.26)

Neutral eyes .35 (.16) .50 (.16)

Fear Neutral mouth .63 (.32) .66 (.26)

Original .76 (.21) .75 (.21)

Neutral eyes .86 (.16) .80 (.31)

Happiness Neutral mouth .28 (.21) .32 (.35)

Original .92 (.11) .98 (.04)

Neutral eyes .25 (.19) .26 (.15)

Sadness Neutral mouth .43 (.17) .45 (.22)

Original .52 (.23) .56 (.26)

information is only present in the other face half (lower or upper region, resp.).

No impairment in the recognition of angry, happy, sad, and fearful and neutral original expressions was found in children with ASD, compared to an age- and IQ-matched group of TD children. Both participant groups performed well above chance on these original expressions, which indicated that our stimulus selection was successful. Indeed, it was necessary for this study to use expressions with a high recognition rate, so that correct identification was still feasible based on a reduced amount of information (when recognizing the hybrid emotions). Although some studies found children with ASD to be outperformed by TD children in basic emotion recognition tasks, nowadays it has been generally accepted that children with ASD (without intellectual disability) mostly succeed in structured emotion processing

tasks, using basic and easily recognizable stimuli [3]. In line with this, a challenge for future applied research is to develop experimental procedures that can tap into the more profound understanding of the meaning of emotions. Besides, one should evaluate whether existing emotion training programs for children with ASD teach them more than mere labelling the basic affects correctly.

Interestingly, we found an interaction between emotion and hybrid type, providing evidence for the existence of top- and bottom-emotions in children. Mouth information holds crucial information to correctly identify the emotion happiness. For the emotions anger, fear, and sadness, the most salient information is located in the region of the eyes. Hereby we nicely replicate and extend the previously demonstrated distinction between top- and bottom-emotions to a group of children with and without a developmental disorder (studies in adults: [38-40]). At the same time, this effect demonstrates that the experiment had sufficient statistical power to pick up subtle performance differences. Moreover, it proves that this method—using hybrid stimuli—is valuable for a coarse evaluation of attentional bias, without the need for eye-movement registration.

In general, original expressions were recognized more accurately than hybrid faces with neutral eyes and hybrid faces with neutral mouth. However, this effect can be mainly attributed to the apparent overrepresentation of top-emotions in the stimulus selection. In addition, providing the most salient or relevant emotional information (mouth or eyes region, for bottom- and top-emotions, resp.) is not only sufficient for a successful identification of the expression, but moreover, adding more emotional cues (namely, the other face half), does not cause a significant increase in performance level. Although it must be noted that a trend in that direction is visible in both groups. These findings could suggest that both groups of children did not integrate emotional information across both face parts, depending mostly on a more local analysis of the salient regions. Since our participant group consisted of young children—all the participants were younger than 10 years—it could indeed be that they tend to use a more feature-based recognition strategy in daily life too. However, it should be noted that the age at which children shift from using a primarily feature-based representation for faces to more holistic encoding processes is not uncontroversial [48, 49]. Although there are inconsistencies, some studies suggest that children with ASD use a more feature-based face processing strategy (for a recent overview, see [20]), which is in line with the neurocognitive theories attributing an atypical, more locally biased perceptual style to individuals with ASD (for two different views on this topic, see [50, 51]). Further research is necessary to explore the role of holistic processing in the emotion recognition in individuals with ASD and the developmental trajectory of this evolution.

This study did not provide evidence for the use of an atypical emotion recognition strategy in children with ASD: children with ASD were not found to rely more on information in the lower part of the face in comparison to TD children. These findings contrast with those of previous work which argued for the higher reliance on the mouth region

in children with ASD ([16, 27, 35, 36], and also see, e.g., [37]). Apparent inconsistencies could be explained by several factors. Stimulus-specific aspects probably play an important role. Previous studies attributed a crucial influence to stimulus complexity, and most importantly, the embedding of the facial stimulus in a social context [3, 18]. It was sometimes suggested that the increased fixation on mouths can be linked to speech perception: children with ASD, and especially the group of children without language disorder, focused on the mouth region as a compensatory mechanism for their difficulties in processing eye information [52]. The use of dynamic and auditory material is consistent with the proposal that more naturalistic and ecologically valid paradigms should be developed in ASD research [27]. In addition, most previous work did not make a distinction between viewing patterns for different expressions, hereby disregarding that the significance of information in the eyes or mouth region could be strongly emotion dependent, as suggested by the difference between top- and bottom-emotions. In addition, compensatory mechanisms could also cause inconsistencies. Although one of the advantages of using hybrid stimuli is the fact that you get an insight into the implicit processing strategies, more cognition- or language-mediated compensatory mechanisms cannot be fully excluded. The unlimited presentation time (which maybe gave the children the time to use compensation strategies), the fact that the experimental group consisted of children without intellectual disability (deficits are more often found in younger children and in children with intellectual disability), the multiple choice response format, the types of stimuli, and the use of basic emotions, could make children to use these compensation strategies. One child, for example, commented while viewing an angry expression that "the eyebrows are turned downwards so this must be angry." Please note that it is nearly impossible to exclude the possibility that the ASD sample useda more time-consuming, less efficient processing strategy. One could argue that designs with a limited presentation time partially exclude this. However, a confusion is created in these instances: it becomes very hard to distinguish between task difficulty and the use of time-consuming compensatory mechanisms. Whenever participants fail at a task using shorter presentation times, it becomes unclear whether this is due to the increased difficulty as such or because of an atypical default processing manner (i.e., a compensation strategy).

Employing an emotion labeling task with static emotional expressions, we found no evidence for an emotion recognition impairment in six-to-eight-year-olds with ASD. Furthermore, using hybrid stimuli, we demonstrated that the face region providing the most salient information is strongly emotion dependent. We hereby extended research findings on top- and bottom-emotions to children with and without a developmental disorder. This factor should be taken into account in future research, and the distinction between top- and bottom-emotions and the impact hereof on scanning patterns should be evaluated. In addition, we showed that coarse attention patterns can be evaluated with this innovative stimulus manipulation technique, which does not require eye-movement registration. Lastly, no evidence for a stronger mouth reliance in ASD was found in our task. Future

research needs to investigate whether the same holds for more complex emotions and for emotions where information of both the upper and lower parts is required to achieve good recognition.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.


The authors are grateful to all participating children and their parents, as well as to the participating special needs schools. they would like to acknowledge the assistance in participant recruitment and testing by Eline Verbeke and want to thank Patricia Bijttebier, Wilfried Peeters, and Eline Verbeke for their careful reading and feedback on a previous version of this paper. This research was funded by a Grant of the Flemish government, awarded to Johan Wagemans (METH/02/08), and an Interdisciplinary Grant of KU Leuven, awarded to Jean Steyaert, Johan Wagemans, and Ilse Noens (IDO 08/013). Kris Evers and Inneke Kerkhof are joint first authors.


[1] I. Nachson, "On the modularity of face recognition: the riddle of domain specificity," Journal of Clinical and Experimental Neuropsychology, vol. 17, no. 2, pp. 256-275,1995.

[2] American Psychiatric Association, Diagnostic and Statistical Manual of Mental Disorders, Washington, DC, USA, 4th edition, 2000.

[3] M. B. Harms, A. Martin, and G. L. Wallace, "Facial emotion recognition in autism spectrum disorders: a review of behavioral and neuroimaging studies," Neuropsychology Review, vol. 20, no. 3, pp. 290-322, 2010.

[4] M. Uljarevic and A. Hamilton, "Recognition of emotions in autism: a formal meta-analysis," Journal of Autism and Developmental Disorders, vol. 43, no. 7, pp. 1517-1526, 2013.

[5] D. Tantam, L. Monaghan, H. Nicholson, and J. Stirling, "Autistic children's ability to interpret faces: a research note," Journal of Child Psychology and Psychiatry and Allied Disciplines, vol. 30, no. 4, pp. 623-630,1989.

[6] G. Celani, M. W. Battacchi, and L. Arcidiacono, "The understanding of the emotional meaning of facial expressions in people with autism," Journal of Autism and Developmental Disorders, vol. 29, no. 1, pp. 57-66,1999.

[7] M. J. Law Smith, B. Montagne, D. I. Perrett, M. Gill, and L. Gallagher, "Detecting subtle facial emotion recognition deficits in high-functioning Autism using dynamic stimuli of varying intensities," Neuropsychologia, vol. 48, no. 9, pp. 2777-2781,2010.

[8] R. P. Hobson, "The autistic child's appraisal of expressions of emotion: a further study," Journal of Child Psychology and PsychiatryandAlliedDisciplines, vol. 27, no. 5, pp. 671-680,1986.

[9] S. Kuusikko, H. Haapsamo, E. Jansson-Verkasalo et al., "Emotion recognition in children and adolescents with autism spectrum disorders," Journal of Autism and Developmental Disorders, vol. 39, no. 6, pp. 938-945, 2009.

[10] M. Prior, B. Dahlstrom, and T.-L. Squires, "Autistic children's knowledge of thinking and feeling states in other people," Journal of Child Psychology and Psychiatry and Allied Disciplines, vol. 31, no. 4, pp. 587-601,1990.

[11] J.-P. Teunisse and B. De Gelder, "Face processing in adolescents with autistic disorder: the inversion and composite effects," Brain and Cognition, vol. 52, no. 3, pp. 285-294, 2003.

[12] J. L. Tracy, R. W. Robins, R. A. Schriber, and M. Solomon, "Is emotion recognition impaired in individuals with autism spectrum disorders?" Journal of Autism and Developmental Disorders, vol. 41, no. 1, pp. 102-109, 2011.

[13] B. Wright, N. Clarke, J. Jordan et al., "Emotion recognition in faces and the use of visual context Vo in young people with high-functioning autism spectrum disorders," Autism, vol. 12, no. 6, pp. 607-626, 2008.

[14] K. Evers, I. Noens, J. Steyaert, and J. Wagemans, "Combining strengths and weaknesses in visual perception of children with an autism spectrum disorder: perceptual matching of facial expressions," Research in Autism Spectrum Disorders, vol. 5, no. 4, pp. 1327-1342, 2011.

[15] G. L. Wallace, L. K. Case, M. B. Harms, J. A. Silvers, L. Ken-worthy, and A. Martin, "Diminished sensitivity to sad facial expressions in high functioning autism spectrum disorders is associated with symptomatology and adaptive functioning," Journal of Autism and Developmental Disorders, vol. 41, no. 11, pp. 1475-1486, 2011.

[16] S. Baron-Cohen, S. Wheelwright, and T. Jolliffe, "Is there a "language of the eyes"? Evidence from normal adults, and adults with autism or Asperger Syndrome," Visual Cognition, vol. 4, no. 3, pp. 311-331,1997.

[17] D. Da Fonseca, A. Santos, D. Bastard-Rosset, C. Rondan, F. Poinso, and C. Deruelle, "Can children with autistic spectrum disorders extract emotions out of contextual cues?" Research in Autism Spectrum Disorders, vol. 3, no. 1, pp. 50-56, 2009.

[18] L. Speer, A. Cook, W. McMahon, and E. Clark, "Face processing in children with autism: effects of stimulus contents and type," Autism, vol. 11, no. 3, pp. 265-277, 2007.

[19] M. Behrmann, G. Avidan, G. L. Leonard et al., "Configural processing in autism and its relationship to face processing," Neuropsychologia, vol. 44, no. 1, pp. 110-129, 2006.

[20] S. Weigelt, K. Koldewyn, and N. Kanwisher, "Face identity recognition in autism spectrum disorders: a review of behavioral studies," Neuroscience and Biobehavioral Reviews, vol. 36, no. 3, pp. 1060-1084, 2012.

[21] T. Langdell, "Recognition of faces: an approach to the study of autism," Journal of Child Psychology and Psychiatry and Allied Disciplines, vol. 19, no. 3, pp. 255-268,1978.

[22] D. M. Riby, G. Doherty-Sneddon, and V. Bruce, "The eyes or the mouth? Feature salience and unfamiliar face processing in Williams syndrome and autism," Quarterly Journal of Experimental Psychology, vol. 62, no. 1, pp. 189-203, 2009.

[23] R. M. Joseph, K. Ehrman, R. McNally, and B. Keehn, "Affective response to eye contact and face recognition ability in children with ASD," Journal of the International Neuropsychological Society, vol. 14, no. 6, pp. 947-955, 2008.

[24] K. Chawarska and F. Shic, "Looking but not seeing: atypical visual scanning and recognition of faces in 2 and 4-Year-old children with Autism spectrum disorder," Journal of Autism and Developmental Disorders, vol. 39, no. 12, pp. 1663-1672, 2009.

[25] W. Jones, K. Carr, and A. Klin, "Absence of preferential looking to the eyes of approaching adults predicts level of social

disability in 2-year-old toddlers with autism spectrum disorder," Archives of General Psychiatry, vol. 65, no. 8, pp. 946-954,2008.

[26] R. M. Joseph and J. Tanaka, "Holistic and part-based face recognition in children with autism," Journal of Child Psychology and Psychiatry and Allied Disciplines, vol. 44, no. 4, pp. 529-542, 2003.

[27] A. Klin, W. Jones, R. Schultz, F. Volkmar, and D. Cohen, "Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism," Archives of General Psychiatry, vol. 59, no. 9, pp. 809-816, 2002.

[28] B. Gepner and F. Feron, "Autism: a world changing too fast for a mis-wired brain?" Neuroscience and Biobehavioral Reviews, vol. 33, no. 8, pp. 1227-1242, 2009.

[29] K. Pelphrey, J. Goldstein, S. Reznick, J. Piven, T. Allison, and G. McCarthy, "The influence of observed gaze shift context and timing upon activity within the superior temporal sulcus," Journal of Cognitive Neuroscience, p. 69, 2002.

[30] J. N. Van Der Geest, C. Kemner, G. Camfferman, M. N. Verbaten, and H. van Engeland, "Looking at images with human figures: comparison between autistic and normal children," Journal of Autism and Developmental Disorders, vol. 32, no. 2, pp. 69-75, 2002.

[31] V. Bruce and A. Young, "Understanding face recognition," The British journal of psychology, vol. 77, pp. 305-327,1986.

[32] J. V. Haxby, E. A. Hoffman, and M. I. Gobbini, "The distributed human neural system for face perception," Trends in Cognitive Sciences, vol. 4, no. 6, pp. 223-233, 2000.

[33] R. Adolphs, D. Tranel, H. Damasio, and A. Damasio, "Impared recognition of emotion in facial expressions following bilateral damage to the human amygdala," Nature, vol. 372, no. 6507, pp. 669-672, 1994.

[34] R. Bruyer, C. Laterre, X. Seron et al., "A case of prosopagnosia with some preserved covert remembrance of familiar faces," Brain and Cognition, vol. 2, no. 3, pp. 257-284, 1983.

[35] T. F. Gross, "The perception of four basic emotions in human and nonhuman faces by children with autism and other developmental disabilities," Journal of Abnormal Child Psychology, vol. 32, no. 5, pp. 469-480, 2004.

[36] K. Rice, J. M. Moriuchi, W. Jones, and A. Klin, "Parsing heterogeneity in autism spectrum disorders: visual scanning of dynamic social scenes in school-aged children," Journal of the American Academy of Child and Adolescent Psychiatry, vol. 51, no. 3, pp. 238-248, 2012.

[37] M. D. Rutherford and A. M. Towns, "Scan path differences and similarities during emotion perception in those with and without autism spectrum disorders," Journal of Autism and Developmental Disorders, vol. 38, no. 7, pp. 1371-1381, 2008.

[38] A. J. Calder, A. M. Burton, P. Miller, A. W. Young, and S. Aka-matsu, "A principal component analysis of facial expressions," Vision Research, vol. 41, no. 9, pp. 1179-1208, 2001.

[39] H. Eisenbarth and G. W. Alpers, "Happy mouth and sad eyes: scanning emotional facial expressions," Emotion, vol. 11, no. 4, pp. 860-865, 2011.

[40] M. L. Smith, G. W. Cottrell, F. Gosselin, and P. G. Schyns, "Transmitting and decoding facial expressions," Psychological Science, vol. 16, no. 3, pp. 184-189, 2005.

[41] E. Scheller, C. Buchel, and M. Gamer, "Diagnostic features of emotional expressions are processed preferentially," PLoS ONE, vol. 7, no. 7, Article ID e41792, 2012.

[42] C. Lord, S. Risi, L. Lambrecht et al., "The Autism Diagnostic Observation Schedule-Generic: a standard measure of social

and communication deficits associated with the spectrum of autism," Journal ofAutism andDevelopmental Disorders, vol. 30, no. 3, pp. 205-223, 2000.

[43] D. Wechsler, Wechsler Intelligence Scale for Children, The Psychological Corporation, London, UK, 3rd edition, 1992.

[44] P. J. Tellegen, J. A. Laros, and M. Winkel, SON-R 2 1/2-7 NietVerbale Intelligentietest, Hogrefe, Amsterdam, The Netherlands, 2003.

[45] J. Grégoire, L'Evaluation clinique de l'intelligence de l'enfant: Théorie et pratique du WISC-III, Mardaga, Sprimont, Belgium, 2000.

[46] M. N. Dailey, G. W. Cottrell, and J. Reilly, "California Facial Expressions (CAFE)," Computer Science and Engineering Departement, UCSD, La Jolla, Calif, USA , 2001, http://www.cs

[47] P. Ekman and W. V.Friesen, The Facial Action Coding System (FACS): A Technique for the Measurement of Facial Action, Consulting Psychologists Press, Palo Alto, Calif, USA, 1978.

[48] E. Pellicano and G. Rhodes, "Holistic processing of faces in preschool children and adults," Psychological Science, vol. 14, no. 6, pp. 618-622, 2003.

[49] S. Carey and R. Diamond, "Are faces perceived as configurations? More by adults than by children?" Visual Cognition, vol. 1, no. 2/3, pp. 253-274,1994.

[50] F. Happe and U. Frith, "The weak coherence account: detail-focused cognitive style in autism spectrum disorders," Journal ofAutism and Developmental Disorders, vol. 36, no. 1, pp. 5-25, 2006.

[51] L. Mottron, M. Dawson, I. Soulières, B. Hubert, and J. Burack, "Enhanced perceptual functioning in autism: an update, and eight principles of autistic perception," Journal ofAutism and Developmental Disorders, vol. 36, no. 1, pp. 27-43, 2006.

[52] C. F. Norbury, J. Brock, L. Cragg, S. Einav, H. Griffiths, and K. Nation, "Eye-movement patterns are associated with communicative competence in autistic spectrum disorders," Journal of Child Psychology and Psychiatry and Allied Disciplines, vol. 50, no. 7, pp. 834-842, 2009.

Copyright of Autism Research & Treatment is the property of Hindawi Publishing Corporation and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use.