Volume 20, Issue 2
  • ISSN 1572-0373
  • E-ISSN: 1572-0381
Buy:$35.00 + Taxes



The use of robots had already been proven to encourage the promotion of social interaction and skills lacking in children with Autism Spectrum Disorders (ASD), who typically have difficulties in recognizing facial expressions and emotions. The main goal of this research is to study the influence of a humanoid robot to develop socio-emotional skills in children with ASD. The children’s performance in game scenarios aiming to develop facial expressions recognition skills is presented. Along the sessions, children who performed the game scenarios with the robot and the experimenter had a significantly better performance than the children who performed the game scenarios without the robot. The main conclusions of this research support that a humanoid robot is a useful tool to develop socio-emotional skills in the intervention of children with ASD, due to the engagement and positive learning outcome observed.


Article metrics loading...

Loading full text...

Full text loading...


  1. Association, A.
    (2013) Diagnostic and Statistical Manual of Mental Disorders, 5th Edition: DSM 5. book-pointUS. 10.1176/appi.books.9780890425596
    https://doi.org/10.1176/appi.books.9780890425596 [Google Scholar]
  2. Bakeman, R. and Gottman, J.
    (1997) Observing interaction: An introduction to sequential analysis. Cambridge Univ Pr.. 10.1017/CBO9780511527685
    https://doi.org/10.1017/CBO9780511527685 [Google Scholar]
  3. Baron-Cohen, S.
    (1991) The development of a theory of mind in autism: deviance and delay?Psychiatric Clinics of North America. 10.1016/S0193‑953X(18)30323‑X
    https://doi.org/10.1016/S0193-953X(18)30323-X [Google Scholar]
  4. Boucenna, S., Narzisi, A., Tilmont, E., Muratori, F., Pioggia, G., Cohen, D., and Chetouani, M.
    (2014) Interactive technologies for autistic children: A review. Cognitive Computation, pages1–19.
    [Google Scholar]
  5. Cabibihan, J.-J., Javed, H., Jr., M. H. A., and Aljunied, S. M.
    (2013) Why robots? a survey on the roles and benefits of social robots in the therapy of children with autism. CoRR, abs/1311.0352.
    [Google Scholar]
  6. Celani, G., Battacchi, M., and Arcidiacono, L.
    (1999) The understanding of the emotional meaning of facial expressions in people with autism. Journal of Autism and Developmental Disorders, 29(1):57–66. 10.1023/A:1025970600181
    https://doi.org/10.1023/A:1025970600181 [Google Scholar]
  7. Charman, T. and Stone, W. L.
    (2006) Social and communication development in autism spectrum disorders: Early identification, diagnosis, and intervention. Guilford Press.
    [Google Scholar]
  8. Clark, T. F., Winkielman, P., and Mcintosh, D. N.
    (2008) Autism and the extraction of emotion from briefly presented facial expressions: Stumbling at the first step of empathy. Emotion, 8(6):803. 10.1037/a0014124
    https://doi.org/10.1037/a0014124 [Google Scholar]
  9. Costa, S., Soares, F., Pereira, A. P., Santos, C., and Hiolle, A.
    (2014a) Building a game scenario to encourage children with autism to recognize and label emotions using a humanoid robot. inRobot and Human Interactive Communication, 2014 RO-MAN: The 23rd IEEE International Symposium on, pages820–825. IEEE.
    [Google Scholar]
  10. Costa, S., Soares, F., and Santos, C.
    (2013) Facial expressions and gestures to convey emotions with a hu-manoid robot. InHerrmann, G., Pearson, M., Lenz, A., Bremner, P., Spiers, A., and Leonards, U., editors, Social Robotics, volume 8239 of Lecture Notes in Computer Science, pages542–551. Springer International Publishing.
    [Google Scholar]
  11. Costa, S., Soares, F. O., Pereira, A. P., Santos, C., and Hiolle, A.
    (2014b) A pilot study using imitation and storytelling scenarios as activities for labelling emotions by children with autism using a humanoid robot. InProceeding of The 4th International Conference on Development and Learning and on Epigenetic Robotics (IEEE ICDL-EPIROB 2014). 10.1109/DEVLRN.2014.6982997
    https://doi.org/10.1109/DEVLRN.2014.6982997 [Google Scholar]
  12. Dautenhahn, K.
    (1999) Robots as social actors: Aurora and the case of autism. InProc. CT99, The Third International Cognitive Technology Conference, August, San Francisco, volume359, page374.
    [Google Scholar]
  13. Dautenhahn, K. and Werry, I.
    (2004) Towards interactive robots in autism therapy: Background, motivation and challenges. Pragmatics & Cognition, 12(1):1–35. 10.1075/pc.12.1.03dau
    https://doi.org/10.1075/pc.12.1.03dau [Google Scholar]
  14. Diehl, J. J., Schmitt, L. M., Villano, M., and Crowell, C. R.
    (2012) The clinical use of robots for individuals with autism spectrum disorders: A critical review. Research in autism spectrum disorders, 6(1):249–262. 10.1016/j.rasd.2011.05.006
    https://doi.org/10.1016/j.rasd.2011.05.006 [Google Scholar]
  15. Ekman, P. and Rosenberg, E. L.
    (1998) What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford University Press, USA.
    [Google Scholar]
  16. Filipe, C.
    (2012) Autismo: conceitos, mitos e preconceitos.
    [Google Scholar]
  17. Giullian, N., Ricks, D., Atherton, A., Colton, M., Goodrich, M., and Brinton, B.
    (2010) Detailed requirements for robots in autism therapy. InSystems Man and Cybernetics (SMC), 2010 IEEE International Conference on, pages2595–2602. IEEE. 10.1109/ICSMC.2010.5641908
    https://doi.org/10.1109/ICSMC.2010.5641908 [Google Scholar]
  18. Hanson, D., Baurmann, S., Riccio, T., Margolin, R., Dockins, T., Tavares, M., and Carpenter, K.
    (2009) Zeno: a cognitive character. InAI Magazine, and special Proc. of AAAI National Conference, Chicago.
    [Google Scholar]
  19. Hobson, R. P.
    (1986) The autistic child’s appraisal of expressions of emotion: A further study. Journal of Child Psychology and Psychiatry, 27(5):671–680. 10.1111/j.1469‑7610.1986.tb00191.x
    https://doi.org/10.1111/j.1469-7610.1986.tb00191.x [Google Scholar]
  20. Huskens, B., Verschuur, R., Gillesen, J., Didden, R., and Barakova, E.
    (2013) Promoting question-asking in school-aged children with autism spectrum disorders: Effectiveness of a robot intervention compared to a human-trainer intervention. Developmental neurorehabilitation, 16(5):345–356. 10.3109/17518423.2012.739212
    https://doi.org/10.3109/17518423.2012.739212 [Google Scholar]
  21. Johnson, C. P., Myers, S. M.,
    (2007) Identification and evaluation of children with autism spectrum disorders. Pediatrics, 120(5):1183–1215. 10.1542/peds.2007‑2361
    https://doi.org/10.1542/peds.2007-2361 [Google Scholar]
  22. Kanade, T., Cohn, J. F., and Tian, Y.
    (2000) Comprehensive database for facial expression analysis. InAutomatic Face and Gesture Recognition, 2000. Proceedings. Fourth IEEE International Conference on, pages46–53. IEEE.
    [Google Scholar]
  23. Lee, J., Takehashi, H., Nagai, C., Obinata, G., and Stefanov, D.
    (2012) Which robot features can stimulate better responses from children with autism in robotassisted therapy?Int. J. Advanced Robotic Systems, 9(72).
    [Google Scholar]
  24. Lee, K. M., Jung, Y., Kim, J., and Kim, S. R.
    (2006) Are physically embodied social agents better than disembodied social agents?: The effects of physical embodiment, tactile interaction, and people’s loneliness in human-robot interaction. International Journal of Human-Computer Studies, 64(10):962–973. 10.1016/j.ijhcs.2006.05.002
    https://doi.org/10.1016/j.ijhcs.2006.05.002 [Google Scholar]
  25. Lima, C. B. D.
    (2012) Perturbações do espectro do autismo: manual prático de intervençao. Lidel.
    [Google Scholar]
  26. Loveland, K. A., Tunali-Kotoski, B., Chen, Y. R., Ortegon, J., Pearson, D. A., Brelsford, K. A., and Gibbs, M. C.
    (1997) Emotion recognition in autism: Verbal and nonverbal information. Development and Psychopathology, null:579–593. 10.1017/S0954579497001351
    https://doi.org/10.1017/S0954579497001351 [Google Scholar]
  27. Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I.
    (2010) The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. InComputer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on, pages94–101. IEEE.
    [Google Scholar]
  28. Mazzei, D., Lazzeri, N., Billeci, L., Igliozzi, R., Mancini, A., Ahluwalia, A., Muratori, F., and De Rossi, D.
    (2011) Development and evaluation of a social robot platform for therapy in autism. InEngineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE, pages4515–4518. IEEE. 10.1109/IEMBS.2011.6091119
    https://doi.org/10.1109/IEMBS.2011.6091119 [Google Scholar]
  29. Mazzei, D., Lazzeri, N., Hanson, D., and De Rossi, D.
    (2012) Hefes: an hybrid engine for facial expressions synthesis to control human-like androids and avatars. InBIOROB 2012 proceedings.
    [Google Scholar]
  30. Mesibov, G. B. and Howley, M.
    (2003) Accessing the curriculum for pupils with autistic spectrum disorders: Using the TEACCH programme to help inclusion. David Fulton Publishers.
    [Google Scholar]
  31. Noldus, L.
    (1991) The observer: A software system for collection and analysis of observational data. Behavior Research Methods, Instruments, & Computers, 23(3):415–429. 10.3758/BF03203406
    https://doi.org/10.3758/BF03203406 [Google Scholar]
  32. Palmen, A., Didden, R., and Lang, R.
    (2012) A systematic review of behavioral intervention research on adaptive skill building in high-functioning young adults with autism spectrum disorder. Research in Autism Spectrum Disorders, 6(2):602–617. 10.1016/j.rasd.2011.10.001
    https://doi.org/10.1016/j.rasd.2011.10.001 [Google Scholar]
  33. Pease, B. and Pease, A.
    (2008) The definitive book of body language. Random House LLC.
    [Google Scholar]
  34. Ramdoss, S., Lang, R., Mulloy, A., Franco, J., OReilly, M., Didden, R., and Lancioni, G.
    (2011) Use of computer-based interventions to teach communication skills to children with autism spectrum disorders: A systematic review. Journal of Behavioral Education, 20(1):55–76. 10.1007/s10864‑010‑9112‑7
    https://doi.org/10.1007/s10864-010-9112-7 [Google Scholar]
  35. Ramdoss, S., Machalicek, W., Rispoli, M., Mulloy, A., Lang, R., and OReilly, M.
    (2012) Computer-based interventions to improve social and emotional skills in individuals with autism spectrum disorders: A systematic review. Developmental neurorehabilitation, 15(2):119–135. 10.3109/17518423.2011.651655
    https://doi.org/10.3109/17518423.2011.651655 [Google Scholar]
  36. Ricks, D. J. and Colton, M. B.
    (2010) Trends and considerations in robot-assisted autism therapy. InRobotics and Automation (ICRA), 2010 IEEE International Conference on, pages4354–4359. IEEE. 10.1109/ROBOT.2010.5509327
    https://doi.org/10.1109/ROBOT.2010.5509327 [Google Scholar]
  37. Russell, J. A.
    (1980) A circumplex model of affect. Journal of personality and social psychology, 39(6):1161. 10.1037/h0077714
    https://doi.org/10.1037/h0077714 [Google Scholar]
  38. Saldien, J., Goris, K., Vanderborght, B., Vanderfaeillie, J., and Lefeber, D.
    (2010) Expressing emotions with the social robot probo. International Journal of Social Robotics, 2(4):377–389. 10.1007/s12369‑010‑0067‑6
    https://doi.org/10.1007/s12369-010-0067-6 [Google Scholar]
  39. Scassellati, B., Admoni, H., and Mataric, M.
    (2012) Robots for use in autism research. Annual Review of Biomedical Engineering, 14:275–294. 10.1146/annurev‑bioeng‑071811‑150036
    https://doi.org/10.1146/annurev-bioeng-071811-150036 [Google Scholar]
  40. Werry, I., Dautenhahn, K., Ogden, B., and Harwin, W.
    (2001) Can social interaction skills be taught by a social agent? the role of a robotic mediator in autism therapy. InCognitive technology: instruments of mind, pages57–74. Springer. 10.1007/3‑540‑44617‑6_6
    https://doi.org/10.1007/3-540-44617-6_6 [Google Scholar]
  41. Zwaigenbaum, L., Bryson, S., Rogers, T., Roberts, W., Brian, J., and Szatmari, P.
    (2005) Behavioral manifestations of autism in the first year of life. International Journal of Developmental Neuroscience, 23(2):143–152. 10.1016/j.ijdevneu.2004.05.001
    https://doi.org/10.1016/j.ijdevneu.2004.05.001 [Google Scholar]

Data & Media loading...

  • Article Type: Research Article
Keyword(s): Autism Spectrum Disorders; emotion recognition; human-robot interaction

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error