Volume 20, Issue 2
  • ISSN 1572-0373
  • E-ISSN: 1572-0381
Buy:$35.00 + Taxes



Autism spectrum disorders (ASD) reduce one’s ability to act appropriately in social situations. Increasing evidence indicates that children with ASD might ignore nonverbal social cues that usually aid social interaction because they do not recognize or understand them. We asked children with ASD to color an augmented reality coloring book (ARCB) to teach them how to recognize and understand some specific social signals and to ignore others. ARCB materials teach children to recognize and understand social signals in various ways. They can, for example, view 3D animations of the ARCB materials on a tablet computer. Thus, the ARCB can be used to help children with ASD focus their attention on the meaning and social value of nonverbal behaviors in specific social situations. The ARCB has multiple functions: it extends the social features of the story, and it restricts attention to the most important parts of the videos. Single-subject research with a multiple-baselines across-subject design was used in this study. After five weeks of ARCB training intervention, all 3 participants’ scores rose significantly and dramatically during the intervention phase (mean rate of correct answers improved from 14.24% to 47.33%), and remained significantly higher in the maintenance phase than at baseline. We conclude that coloring pictures of social situations may help children with ASD recognize and better understand these situations.


Article metrics loading...

Loading full text...

Full text loading...


  1. Attwood, T.
    (2006) The complete guide to Asperger’s syndrome. Jessica Kingsley Publishers.
    [Google Scholar]
  2. American Psychiatric Association
    American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders (DSM-5®). American Psychiatric Pub.10.1176/appi.books.9780890425596
    https://doi.org/10.1176/appi.books.9780890425596 [Google Scholar]
  3. Baker, J. E.
    (2003a) Social skills picture book: Teaching play, emotion, and communication to children with autism. Arlington, TX: Future Horizons.
    [Google Scholar]
  4. (2003b) Social skills training. Overland Park, KS: Autism Asperger Publishing.
    [Google Scholar]
  5. Baird, G., & Norbury, C. F.
    (2016) Social (pragmatic) communication disorders and autism spectrum disorder. Archives of Disease in Childhood, 101(8), 745–751. 10.1136/archdischild‑2014‑306944
    https://doi.org/10.1136/archdischild-2014-306944 [Google Scholar]
  6. Broadhead, P.
    (2006) Developing an understanding of young children’s learning through play: the place of observation, interaction and reflection. British Educational Research Journal, 32(2), 191–207. 10.1080/01411920600568976
    https://doi.org/10.1080/01411920600568976 [Google Scholar]
  7. Castelli, F.
    (2005) Understanding emotions from standardized facial expressions in autism and normal development. Autism, 9(4), 428–449. 10.1177/1362361305056082
    https://doi.org/10.1177/1362361305056082 [Google Scholar]
  8. Chen, C. H., Lee, I. J., & Lin, L. Y.
    (2015) Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders. Research in developmental disabilities, 36, 396–403. 10.1016/j.ridd.2014.10.015
    https://doi.org/10.1016/j.ridd.2014.10.015 [Google Scholar]
  9. (2016) Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Computers in Human Behavior, 55, 477–485. 10.1016/j.chb.2015.09.033
    https://doi.org/10.1016/j.chb.2015.09.033 [Google Scholar]
  10. Clark, A., & Dünser, A.
    (2012, March). An interactive augmented reality coloring book. In3D User Interfaces (3DUI), 2012 IEEE Symposium on (pp.7–10). IEEE. 10.1109/3DUI.2012.6184168
    https://doi.org/10.1109/3DUI.2012.6184168 [Google Scholar]
  11. Curry, N. A., & Kasser, T.
    (2005) Can coloring mandalas reduce anxiety?Art Therapy, 22(2), 81–85. 10.1080/07421656.2005.10129441
    https://doi.org/10.1080/07421656.2005.10129441 [Google Scholar]
  12. Escobedo, L., Tentori, M., Quintana, E., Favela, J., & Garcia-Rosas, D.
    (2014) Using augmented reality to help children with autism stay focused. IEEE Pervasive Computing, 13(1), 38–46.
    [Google Scholar]
  13. Farr, W., Yuill, N., & Hinske, S.
    (2012) An augmented toy and social interaction in children with autism. International Journal of Arts and Technology, 5(2–4), 104–125. 10.1504/IJART.2012.046270
    https://doi.org/10.1504/IJART.2012.046270 [Google Scholar]
  14. Fodstad, J. C., Matson, J. L., Hess, J., & Neal, D.
    (2009) Social and communication behaviours in infants and toddlers with autism and pervasive developmental disorder-not otherwise specified. Developmental Neurorehabilitation, 12(3), 152–157. 10.1080/17518420902936748
    https://doi.org/10.1080/17518420902936748 [Google Scholar]
  15. Geschwind, D. H., & Levitt, P.
    (2007) Autism spectrum disorders: developmental disconnection syndromes. Current opinion in neurobiology, 17(1), 103–111. 10.1016/j.conb.2007.01.009
    https://doi.org/10.1016/j.conb.2007.01.009 [Google Scholar]
  16. Gray, C. A.
    (1998) Social stories and comic strip conversations with students with Asperger syndrome and high-functioning autism. Asperger syndrome or high-functioning autism?, 167–198. 10.1007/978‑1‑4615‑5369‑4_9
    https://doi.org/10.1007/978-1-4615-5369-4_9 [Google Scholar]
  17. Heath, M. A., Sheen, D., Leavy, D., Young, E., & Money, K.
    (2005) Bibliotherapy: A resource to facilitate emotional healing and growth. School Psychology International, 26(5), 563–580. 10.1177/0143034305060792
    https://doi.org/10.1177/0143034305060792 [Google Scholar]
  18. Hedley, N. R.
    (2003, August). Empirical evidence for advanced geographic visualization interface use. InInternational cartographic congress, Durban, South Africa.
    [Google Scholar]
  19. Hobson, R. P., & Lee, A.
    (1998) Hello and goodbye: A study of social engagement in autism. Journal of autism and developmental disorders, 28(2), 117–127. 10.1023/A:1026088531558
    https://doi.org/10.1023/A:1026088531558 [Google Scholar]
  20. Hornecker, E., & Buur, J.
    (2006, April). Getting a grip on tangible interaction: a framework on physical space and social interaction. InProceedings of the SIGCHI conference on Human Factors in computing systems (pp.437–446). ACM. 10.1145/1124772.1124838
    https://doi.org/10.1145/1124772.1124838 [Google Scholar]
  21. Hoyek, N., Di Rienzo, F., Collet, C., Creveaux, T., & Guillot, A.
    (2014) Hand mental rotation is not systematically altered by actual body position: Laterality judgment versus same–different comparison tasks. Attention, Perception, & Psychophysics, 76(2), 519–526. 10.3758/s13414‑013‑0577‑z
    https://doi.org/10.3758/s13414-013-0577-z [Google Scholar]
  22. Jarrold, C.
    (2003) A review of research into pretend play in autism. Autism, 7(4), 379–390. 10.1177/1362361303007004004
    https://doi.org/10.1177/1362361303007004004 [Google Scholar]
  23. Kaufmann, H., & Schmalstieg, D.
    (2003) Mathematics and geometry education with collaborative augmented reality. Computers & Graphics, 27(3), 339–345. 10.1016/S0097‑8493(03)00028‑1
    https://doi.org/10.1016/S0097-8493(03)00028-1 [Google Scholar]
  24. Klatzky, R. L., Wu, B., Shelton, D., & Stetten, G.
    (2008) Effectiveness of augmented-reality visualization versus cognitive mediation for learning actions in near space. ACM Transactions on Applied Perception (TAP), 5(1), 1. 10.1145/1279640.1279641
    https://doi.org/10.1145/1279640.1279641 [Google Scholar]
  25. Koegel, L. K., Vernon, T. W., Koegel, R. L., Koegel, B. L., & Paullin, A. W.
    (2012) Improving social engagement and initiations between children with autism spectrum disorder and their peers in inclusive settings. Journal of Positive Behavior Interventions, 14(4), 220–227. 10.1177/1098300712437042
    https://doi.org/10.1177/1098300712437042 [Google Scholar]
  26. Koldewyn, K., Weigelt, S., Kanwisher, N., & Jiang, Y.
    (2013) Multiple objects tracking in autism spectrum disorders. Journal of autism and developmental disorders, 43(6), 1394–1405. 10.1007/s10803‑012‑1694‑6
    https://doi.org/10.1007/s10803-012-1694-6 [Google Scholar]
  27. Krasny, L., Williams, B. J., Provencal, S., & Ozonoff, S.
    (2003) Social skills interventions for the autism spectrum: essential ingredients and a model curriculum. Child and Adolescent Psychiatric Clinics of North America, 12(1), 107–122. 10.1016/S1056‑4993(02)00051‑2
    https://doi.org/10.1016/S1056-4993(02)00051-2 [Google Scholar]
  28. Lee, I. J., Chen, C. H., & Chang, K. P.
    (2016) Augmented reality technology combined with three-dimensional holography to train the mental rotation ability of older adults. Computers in Human Behavior, 65, 488–500. 10.1016/j.chb.2016.09.014
    https://doi.org/10.1016/j.chb.2016.09.014 [Google Scholar]
  29. Lillard, A. S., Lerner, M. D., Hopkins, E. J., Dore, R. A., Smith, E. D., & Palmquist, C. M.
    (2013) The impact of pretend play on children’s development: A review of the evidence. Psychological bulletin, 139(1), 1. 10.1037/a0029321
    https://doi.org/10.1037/a0029321 [Google Scholar]
  30. Lu, L., Petersen, F., Lacroix, L., & Rousseau, C.
    (2010) Stimulating creative play in children with autism through sandplay. The Arts in Psychotherapy, 37(1), 56–64. 10.1016/j.aip.2009.09.003
    https://doi.org/10.1016/j.aip.2009.09.003 [Google Scholar]
  31. Marshall, P.
    (2007, February). Do tangible interfaces enhance learning?InProceedings of the 1st international conference on tangible and embedded interaction (pp.163–170). ACM. 10.1145/1226969.1227004
    https://doi.org/10.1145/1226969.1227004 [Google Scholar]
  32. Martins, M. P., & Harris, S. L.
    (2006) Teaching children with autism to respond to joint attention initiations. Child & Family Behavior Therapy, 28(1), 51–68. 10.1300/J019v28n01_04
    https://doi.org/10.1300/J019v28n01_04 [Google Scholar]
  33. Matson, J. L.
    (2009) Applied behavior analysis for children with autism spectrum disorders. New York: Springer. 10.1007/978‑1‑4419‑0088‑3
    https://doi.org/10.1007/978-1-4419-0088-3 [Google Scholar]
  34. Magnenat, S., Ngo, D. T., Zünd, F., Ryffel, M., Noris, G., Rothlin, G., … & Sumner, R. W.
    (2015) Live texturing of augmented reality characters from colored drawings. IEEE transactions on visualization and computer graphics, 21(11), 1201–1210. 10.1109/TVCG.2015.2459871
    https://doi.org/10.1109/TVCG.2015.2459871 [Google Scholar]
  35. McPartland, J. C., Webb, S. J., Keehn, B., & Dawson, G.
    (2011) Patterns of visual attention to face and objects in autism spectrum disorder. Journal of Autism and Developmental Disorders, 41(2), 148–157. 10.1007/s10803‑010‑1033‑8
    https://doi.org/10.1007/s10803-010-1033-8 [Google Scholar]
  36. Moser, T., & Martinsen, M. T.
    (2010) The outdoor environment in Norwegian kindergartens as pedagogical space for toddlers’ play, learning and development. European Early Childhood Education Research Journal, 18(4), 457–471. 10.1080/1350293X.2010.525931
    https://doi.org/10.1080/1350293X.2010.525931 [Google Scholar]
  37. Mundy, P., Sigman, M., Ungerer, J., & Sherman, T.
    (1986) Defining the social deficits of autism: the contribution of non-verbal communication measures. Journal of Child Psychology and Psychiatry, 27(5), 657–669. 10.1111/j.1469‑7610.1986.tb00190.x
    https://doi.org/10.1111/j.1469-7610.1986.tb00190.x [Google Scholar]
  38. Mynarikova, L.
    (2012) Art-Based Program for Social and Emotional Development of Children. Online Submission.
    [Google Scholar]
  39. QuiverVision
    QuiverVision (2016) Quiver Augmented Reality used as art therapy for veterans. Retrieved fromwww.quivervision.com/quiver-augmented-reality-used-art-therapy-veterans/
  40. Reynhout, G., & Carter, M.
    (2006) Social Stories™ for children with disabilities. Journal of autism and developmental disorders, 36(4), 445–469. 10.1007/s10803‑006‑0086‑1
    https://doi.org/10.1007/s10803-006-0086-1 [Google Scholar]
  41. Ryan, C., & Ni Charragain, C.
    (2010) Teaching emotion recognition skills to children with autism. Journal of Autism and Developmental Disorders, 40(12), 1505–1511. 10.1007/s10803‑010‑1009‑8
    https://doi.org/10.1007/s10803-010-1009-8 [Google Scholar]
  42. Shelton, B. E., & Hedley, N. R.
    (2004) Exploring a cognitive basis for learning spatial relationships with augmented reality. Technology, Instruction, Cognition and Learning, 1(4), 323.
    [Google Scholar]
  43. Sparrow, S. S.
    (2011) Vineland adaptive behavior scales. InEncyclopedia of Clinical Neuropsychology (pp.2618–2621). Springer New York. 10.1007/978‑0‑387‑79948‑3_1602
    https://doi.org/10.1007/978-0-387-79948-3_1602 [Google Scholar]
  44. Wraga, M., Thompson, W. L., Alpert, N. M., & Kosslyn, S. M.
    (2003) Implicit transfer of motor strategies in mental rotation. Brain and Cognition, 52(2), 135–143. 10.1016/S0278‑2626(03)00033‑2
    https://doi.org/10.1016/S0278-2626(03)00033-2 [Google Scholar]
  45. Yuill, N., Strieth, S., Roake, C., Aspden, R., & Todd, B.
    (2007) Brief Report: Designing a Playground for Children with Autistic Spectrum Disorders––Effects on Playful Peer Interactions. Journal of autism and developmental disorders, 37(6), 1192–1196. 10.1007/s10803‑006‑0241‑8
    https://doi.org/10.1007/s10803-006-0241-8 [Google Scholar]
  46. Zünd, F., Ryffel, M., Magnenat, S., Marra, A., Nitti, M., Kapadia, M., … & Sumner, R. W.
    (2015, November). Augmented creativity: bridging the real and virtual worlds to enhance creative play. InSIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications (p.21). ACM.

Data & Media loading...

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error