01 The Brief
Can technology bring kids closer to nature?
Parents value what technology can teach their kids, but worry it replaces climbing, touching and noticing the world around them. Sprig explores the opposite: an AI-powered toy that sends kids outside.
Place a pinecone, leaf or rock on Sprig, and it recognizes the object and turns it into music that kids shape with knobs and sliders. On our team of three, I led research on the physical interaction and did the 3D modeling and printing.
Timeline & methods: foundational research and literature review, exploratory parent interviews, concept ideation with speculative design, physical prototyping, electronics and software engineering, then contextual inquiry and design iteration.
02 Research
Why nature, and why now
Before design, I worked in environmental education, leading nature walks and K–5 programs at UC Santa Barbara. Research backs what I saw there: hands-on time outdoors builds curiosity, confidence and a sense of belonging.
In exploratory interviews, parents described a balance: they want technology to help kids understand the world, not escape from it. That led to my question: how might an artifact use AI to support curiosity, movement and real-world exploration?
“What worries me is when technology stops being a tool and starts replacing their relationship with the physical world.” — Martha, 33, first-time parent
“The balance I’m constantly negotiating as a parent is helping them use technology as a way to understand the world, not an escape from it.” — Owen, 41, father of two


03 Concept
Turning natural objects into instruments
I chose music as the medium because it's a familiar, inviting way in. Kids gather things outside, place them on Sprig, and hear each object become its own sound.
Google's Teachable Machine acts as the eyes, p5.js is the brain and the instrument, and an Arduino gives kids hands-on control through tactile knobs and sliders.






04 Prototyping
Designing the physical form
I modeled the enclosure and internal components in Fusion 360, then 3D printed the body and custom tactile buttons on Bambu PLA and Form 4 resin printers. Laser-cut panels let us iterate quickly on the control layout.
Inside, an ESP32 Feather wirelessly connects the knobs, switches and speaker to the computer vision and sound system.




05 Testing
“What sound does a pinecone make?”
Design implications: large, clearly distinguishable buttons beat labeled or small ones, and obvious cause-and-effect feedback mattered more than icons or technical labels.
Labels vs. no labels didn't interfere with play, and calm yet responsive music encouraged kids to keep experimenting.


06 Reflection
What's next
Sprig was my first end-to-end research and design project for hardware, and it brought my environmental education background into design. It deepened my interest in educational, inclusive physical–digital experiences.
Next, I'd study long-term use in classrooms and at home, accessibility across abilities, and whether a physical, multi-modal AI shifts how kids and parents see AI beyond chatbots and screens.


Showing Sprig at the Berkeley MDes showcase.
