Sprig – Fall 2025

A playful outdoor toy that uses computer vision to turn natural objects into music.
A 4-week project with Ajia Grant & Jillian Silva.
I led research on the physical interaction, plus the 3D modeling and printing.

Hardware

Physical prototyping

Onsite research

Role

UX Researcher & Designer

Tools

Fusion 360, p5.js, Arduino

Timeline

4 weeks

TEAM

Ajia Grant, Jillian Silva

Sprig, final prototype.

01 The Brief

Can technology bring kids closer to nature?

Parents value what technology can teach their kids, but worry it replaces climbing, touching and noticing the world around them. Sprig explores the opposite: an AI-powered toy that sends kids outside.

Place a pinecone, leaf or rock on Sprig, and it recognizes the object and turns it into music that kids shape with knobs and sliders. On our team of three, I led research on the physical interaction and did the 3D modeling and printing.

Timeline & methods: foundational research and literature review, exploratory parent interviews, concept ideation with speculative design, physical prototyping, electronics and software engineering, then contextual inquiry and design iteration.



02 Research

Why nature, and why now

Before design, I worked in environmental education, leading nature walks and K–5 programs at UC Santa Barbara. Research backs what I saw there: hands-on time outdoors builds curiosity, confidence and a sense of belonging.

In exploratory interviews, parents described a balance: they want technology to help kids understand the world, not escape from it. That led to my question: how might an artifact use AI to support curiosity, movement and real-world exploration?

“What worries me is when technology stops being a tool and starts replacing their relationship with the physical world.” — Martha, 33, first-time parent

“The balance I’m constantly negotiating as a parent is helping them use technology as a way to understand the world, not an escape from it.” — Owen, 41, father of two

Leading nature-based programs for K–5 students at UC Santa Barbara.

Leading nature-based programs for K–5 students at UC Santa Barbara.

Leading nature-based programs for K–5 students at UC Santa Barbara.

03 Concept

Turning natural objects into instruments

I chose music as the medium because it's a familiar, inviting way in. Kids gather things outside, place them on Sprig, and hear each object become its own sound.

Google's Teachable Machine acts as the eyes, p5.js is the brain and the instrument, and an Arduino gives kids hands-on control through tactile knobs and sliders.

04 Prototyping

Designing the physical form

I modeled the enclosure and internal components in Fusion 360, then 3D printed the body and custom tactile buttons on Bambu PLA and Form 4 resin printers. Laser-cut panels let us iterate quickly on the control layout.

Inside, an ESP32 Feather wirelessly connects the knobs, switches and speaker to the computer vision and sound system.

My Fusion 360 model, the printed enclosure, resin-printed buttons, and wiring the controls.

05 Testing

“What sound does a pinecone make?”

Design implications: large, clearly distinguishable buttons beat labeled or small ones, and obvious cause-and-effect feedback mattered more than icons or technical labels.

Labels vs. no labels didn't interfere with play, and calm yet responsive music encouraged kids to keep experimenting.

06 Reflection

What's next

Sprig was my first end-to-end research and design project for hardware, and it brought my environmental education background into design. It deepened my interest in educational, inclusive physical–digital experiences.

Next, I'd study long-term use in classrooms and at home, accessibility across abilities, and whether a physical, multi-modal AI shifts how kids and parents see AI beyond chatbots and screens.

Showing Sprig at the Berkeley MDes showcase.

Sprig
Fall 2025

A playful outdoor toy that uses computer vision to turn natural objects into music.

A 4-week project with Ajia Grant & Jillian Silva.
I led research on the physical interaction, plus the 3D modeling and printing.

Hardware

Physical prototyping

Onsite research

Role

UX Researcher &

Designer

Timeline

4 weeks

Tools

Fusion 360, p5.js,

Arduino

TEAM

Ajia Grant,

Jillian Silva