The Humming Box

Hum, Insert, Crank to Create your Melody 

SCOPE

Product Design | AI | Physical Computation | Rapid Prototype | UX research | Research Paper

ELEMENTS 

Arduino MKR Zero | NeoPixel | Rotary Encoder

Key Switch | Wood | Acrylic | MIDI | GarageBand

DURATION

Prototyping: 3 Month (Part-time)

Research Paper: 1 Month (Part-time)

TOOLS

C | Laster Cutter | Acrylic Heat Bender | Drills | AI (Pitch Detection) | Sketch | LaTex

Logo_App Icon Main - 1024x1024.png
Logo_App Icon Main - 1024x1024.png

Humming Box is a simple and playful smart toy designed for 4-6-year-old children. It allows them to create, remix, and perform their melody or the music they like – through the interaction of hum, card insert and crank.  

CONTRIBUTION

All members contributed to concept development, user research, interaction design, usability tests, technical troubleshooting, and research paper writing. 

MY CONTRIBUTION

Ideation:  humming to cranking interaction, card insert interaction 

Mechanism: card insert mechanism, cranking mechanism   
Technology: MIDI USB to GarageBand, rotary encoder reading,

                      pitch detection research
Fabrication:  instrument card design, card Holder, box 
body

Visual: demo video editing, visual system design, icon retouch

TEAM'S CONTRIBUTION

 

Chunhan Chen - Code structure, NeoPixel animation, card insert detection, rotary encoder stabilization, MIDI notes, keyboard control, Pitch detection algorithm exploration; cranking handle fabrication; Icon.

 

Yihan Tang - NeoPixel connection; Box surface design and fabrication; Card design perfection, NeoPixel holder & box body fabrication; video retouch 

 

Advisor: Stefania Druga – Hacking Smart Toy for AI Learning

Special Thanks: Daniel Shiffman, Tom Igoe and the ITP residents who provided insight and expertise that greatly assisted our research and technical issues.  

ACHIEVEMENT
 
Design & Research

1. 3 iterations of functional prototypes

2. ~ 50 children playtest participant

3. ~ 100 teens & adult playtest & feedback. 

4. ~ 20+ expert review and insight

Technology 

1. Crank interaction to MIDI signal and NeoPixel 

2. Card Insert to MIDI USB 

Research Paper – CHI PLAY 2019:

Published in ACM CHI PLAY '19 Extended Abstracts Exhibition at CHI PLAY 2019 in Barcelona, Spain 

 

Not Included

1. Experience research of human voice pitch detection to MIDI notes (AI) – updated on Oct 2019 

2. The appearance design of humming box (for children)

3. Tangible Interaction of hum to midi (now is web-based)

WEB AI INTERACTION (Recent Update)

As of Oct 2019, thanks to our amazing technical expert Chunhan's hard works, our project achieved an AI-powered pitch-detection feature through a web-based service – which allows our users to sing/hum a melody and crank out their own creation of music. 

01. OVERVIEW

A product that empowers children's ability to compose and perform music.

OVERVIEW

Music education benefits children's mental and intellectual development in early childhood.

 

Guided by child-centered design principles, we propose "Humming Box", an AI-powered tangible music toy for 4-6-year-old children. The main goal of our project is to blend traditional hand crank music boxes with software-based music manipulation and create new possibilities for children to create and remix music manually.

 

Our project presents findings from 3 design sprints; each demonstrating playtest results and new design iterations. The user evaluation of our final design suggests that multimodal musical creation leads to increased engagement. We also discuss how the modular design of our toy's functional components encourages creative expression and cooperative play.

PROBLEM STATEMENT

Main Challenge

 

Traditional music composing training presents a higher barrier of entry due to additional cost, time, money, and effort in fundamental music education.

How can we provide a tool for young children to encourage their music composition passion without a steep learning curve?  

Supplement Challenge

 

Children's increasing screen time and monotonous interaction habits in the digital era raised our concern.

Read more about effects of screentime on the health and well-being of children.

HOW / WHY IT WORKS
4489258C-C403-4109-9ACB-87B9D936882C.png
PROJECT PROCESS
Timeline.png
 

02. IDEATION

Design a playful music toy for educational experience

BRAINSTORMING
12-5-19, 11_51 AM Office Lens.jpeg