School of Sand
Overview
The Challenge
A novel method to engage tactile senses to facilitate learning in children through computer vision and machine learning.
UX ResearchTangible ProductMachine LearningComputer Vision
Core Strategy
Problem & Solution
The Limits of Flat Screens
Modern screen-based learning blocks physical tactile feedback. Children learn best by touch, but current digital tools ignore spatial depth and physical texture, resulting in shallow spatial comprehension.
Engaging Tactile Interfaces
We engineered a machine-learning-enhanced physical interface that maps hands and sandy surfaces to dynamic audio-visual feedback. Using computer vision to capture tactile manipulations, children receive real-time, multisensory lessons.
Execution Details
Key Focus Areas
01
Tactile Computer Vision
Maps sandbox structures using depth sensors to generate custom color overlays and auditory guides.