top of page
大图 拷贝.jpg
taikomirror logo 立体.png

The TaikoMirror is a smart mirror designed for children with autism to dress up step by step.

What is Autism

Autism Spectrum Disorder (ASD), is a neurodevelopmental disorder that affects how individuals perceive and interact with the world around them. Children with autism, display a wide range of symptoms and characteristics, but some common features include: Social Challenges, Communication Difficulties, Repetitive Behaviors, Sensory Sensitivities and Special Interests.

Group 68 1.png

Autism Spectrum disorder Facts

Group 25 1.png
Group 67 1.png

- The overall ASD prevalence was 27.6 per 1,000 (one in 36)
- About
90% of ASD individuals have atypical sensory experiences, described as both hyper- and hypo-reactivity.
- Individuals with ASD are
visual learners, they typically respond well to using computers and iPads.

Autism Spectrum Disorder & Visual hypersensitivity

brain has allocated more brain resources in the areas associated with visual detection resulting in visual hypersensitivity.

Types of Visual Representations

For ASD young children , visual supports are a fairly non intrusive intervention strategy that can be individualized easily to provide assistance in the areas of social and behavioral learning.

Group 70.png
Group 149.png

Daily usage of Visual Task Analysis

Rectangle 10.png
user map 1 拷贝.png

User Map Study

There are some steps in their daily routine that they have trouble dealing with. Finding the problems and figuring out the specific solutions for these would the next steps

ASD children with dressing problem

Based on the research, I have found that many children with ASD face difficulties with dressing, such as distinguishing the front from the back of their pants or knowing how to begin the process of getting dressed.

Group 150.png

ASD children with different materials

All participants reported hyper-responsiveness to fabrics and textures, both in their surroundings and in their clothing. They experienced irritation, discomfort, and distraction or confusion due to restrictive, itchy, and uncomfortable fabrics.

ASD children Daily Routine Challenges

Group 185.png

Dressing Routine Research

Group 186.png
Group 152.png

Idea Exploration

leveraging ASD children's interest in physical schedules and their hypersensitivity. Through several iterations, this concept developed into the final product.

Refined Concepts

Group 153.png

Final Concepts

The final concept uses a smart mirror to guide ASD children through dressing step-by-step, with a cartoon figure host providing demonstrations to promote independence.

Work Flow

This product leverages the visual hypersensitivity characteristics of children with ASD. By using proven visual representations such as real objects, photographs, words, and line drawings, it captures their attention and serves as an effective guide to help them get dressed. This approach aims to enhance children's independence and reduce or eliminate the need for adult prompting.

Group 165.png
高清final大图 拷贝.jpg
taikomirror logo 立体.png
Group 113 1.png

AI Assistant

The virtual assistant is an AI-powered application that accepts voice commands and performs desired actions. It can schedule the dressing process for children with ASD based on their parents' input regarding unique preferences and create personalized training demos. Integrating AI technologies like machine learning and natural language processing provides core processing for these applications.

Group 116 1.png

Input & Output

Parents can input their children's preferences, challenges, and struggles into the program, which then generates tailored solutions to address these issues. For instance, if a child with ASD has trouble with buttons, the virtual assistant will provide a specific demo for them to practice.

Group 114.png

AI Power Machine Learning

To enhance the workflow, machine learning will be utilized. This will enable the smart mirror to accurately determine whether children with ASD are following the demonstration correctly and provide corrective feedback as needed.

Hardware & Technology

Group 167.png

To evaluate the feasibility of this concept, I connected the Arduino Uno with a display panel and converted the low-fidelity figure GIF into code to animate it on the display.

Coding & Test-out

I used seven different PNG images to create an animated GIF and wrote code to display and animate it on the screen.

How the TaikoMirror generates demo

User Interface Flow

The virtual assistant is AI-powered to accept voice commands, schedule dressing routines for ASD children based on parental input, and create personalized training demos using machine learning and natural language processing.

46.png

How ASD Children use it

Children with ASD start the smart mirror by activating the virtual assistant to begin their dressing routine. First, they select their outfit and retrieve it. They then instruct the assistant to display a dressing demo and follow along. The program monitors their actions, providing corrections if needed. After completing the task, a star LED lights up. Once they earn seven stars, a reward mechanism is triggered. Parents also receive feedback on their child’s progress.

47.png
final logotype pink.png

Los Angeles

Shanghai

(+1) 626. 353. 3924

(+86) 189. 8972. 9999

© Copyright Alvin Xiaoao Zheng. All Rights Reserved
bottom of page