Google Glass helps kids with autism read facial expressions – Stanford Medical Center Report

Typically developing children learn to recognize emotions by engaging with people around them. For children with autism, it’s different. “They don’t pick those things up without focused treatment,” Wall said.

In the study, 14 families tested the Superpower Glass setup at home for an average of 10 weeks each. Each family had a child between the ages of 3 and 17 with a clinically confirmed autism diagnosis.

The families used the therapy for at least three 20-minute sessions per week. At the start and end of the study, parents completed questionnaires to provide detailed information about their child’s social skills. In interviews, parents and children also gave feedback about how the program worked for their families.

The researchers designed three ways to use the face-recognizing program: In “free play,” children wear Google Glass while interacting or playing with their families, and the software provides the wearer with a visual or auditory cue each time it recognizes an emotion on the face of someone in the field of view. There are also two game modes. In “guess my e­­­­­­motion,” a parent acts out a facial expression corresponding to one of the eight core emotions, and the child tries to identify it. The game helps families and researchers track children’s improvement at identifying emotions. In “capture the smile,” children give another person clues about the emotion they want to elicit, until the other person acts it out, which helps the researchers gauge the children’s understanding of different emotions.

Good reviews from families

Families told the researchers that the system was engaging, useful and fun. Kids were willing to wear the Google Glass, and the devices withstood the wear and tear of being used by children.

Twelve of the 14 families, including Alex’s, said their children made more eye contact after receiving the treatment. A few weeks into the trial, Alex began to realize that people’s faces hold clues to their feelings. “He told me, ‘Mommy, I can read minds!’” Cullenbine said. “My heart sang. I’d like other parents to have the same experience.”

Families whose children had more severe autism were more likely to choose the game modes rather than free play, the researchers reported.

The only way to break through the problem is to create reliable, home-based treatment systems.

The children’s mean score on the SRS-2, a questionnaire completed by parents to evaluate children’s social skills, decreased by 7.38 points during the study, indicating less severe symptoms of autism. None of the participants’ SRS-2 scores increased during the study, meaning nobody’s autism symptoms worsened. Six of the 14 participants had large enough declines in their scores to move down one step in the severity of their autism classification: four from “severe” to “moderate,” one from “moderate” to “mild” and one from “mild” to “normal.”

The results should be interpreted with caution since the study did not have a control arm, Wall said. However, the findings are promising, he added.

Parents’ comments in interviews helped illustrate the improvements, he said. “Parents said things like ‘A switch has been flipped; my child is looking at me.’ Or ‘Suddenly the teacher is telling me that my child is engaging in the classroom.’ It was really heartwarming and super-encouraging for us to hear,” Wall said.

His team is currently completing a larger, randomized trial of the therapy. In addition, they also plan to test the therapy in children who have just been diagnosed with autism and are on a waiting list for treatment. Stanford University has filed a patent application for the technology.

Information about the project is available online.

The study’s other Stanford authors are clinical research coordinators Jena Daniels and Jessey Schwartz; graduate students Catalin Voss and Peter Washington; postdoctoral scholar Nick Haber, PhD; software engineer Azar Fazel; software developer Aaron Kline; Carl Feinstein, MD, professor emeritus of psychiatry and behavioral sciences; and Terry Winograd, PhD, professor emeritus of computer science.

Wall, Feinstein and Winograd are members of Stanford Bio-X and the Stanford Child Health Research Institute. Wall is also a member of the Stanford Neurosciences Institute.

The research was funded by grants from the National Institutes of Health (grants 1R21HD091500 and 1R01EB025025), Stanford’s Clinical and Translational Science Award (NIH grant UL1TR001085), the David and Lucile Packard Foundation, the Beckman Center for Molecular and Genetic Medicine, the Wallace H. Coulter Foundation, Stanford’s Walter V. and Idun Berry Postdoctoral Fellowship Program, the Stanford Child Health Research Institute, the Dekeyser and Friends Foundation and the Mosbacher Family Fund for Autism Research, as well as an individual gift from Peter Sullivan. The researchers received an in-kind gift from Google of 35 Google Glass devices as well as technical assistance from the company, and an in-kind grant of Amazon Web Services Founder Support.

Stanford’s Department of Pediatrics also supported the work.

Leave a Reply

Your email address will not be published. Required fields are marked *