The Humming Box
Hum, Insert, Crank to Create your Melody
SCOPE
Product Design | AI | Physical Computation | Rapid Prototype | UX research | Research Paper
ELEMENTS
Arduino MKR Zero | NeoPixel | Rotary Encoder
Key Switch | Wood | Acrylic | MIDI | GarageBand
DURATION
Prototyping: 3 Month (Part-time)
Research Paper: 1 Month (Part-time)
TOOLS
C | Laster Cutter | Acrylic Heat Bender | Drills | AI (Pitch Detection) | Sketch | LaTex
Humming Box is a simple and playful smart toy designed for 4-6-year-old children. It allows them to create, remix, and perform their melody or the music they like – through the interaction of hum, card insert and crank.
CONTRIBUTION
All members contributed to concept development, user research, interaction design, usability tests, technical troubleshooting, and research paper writing.
MY CONTRIBUTION
Ideation: humming to cranking interaction, card insert interaction
Mechanism: card insert mechanism, cranking mechanism
Technology: MIDI USB to GarageBand, rotary encoder reading,
pitch detection research
Fabrication: instrument card design, card Holder, box body
Visual: demo video editing, visual system design, icon retouch
Chunhan Chen - Code structure, NeoPixel animation, card insert detection, rotary encoder stabilization, MIDI notes, keyboard control, Pitch detection algorithm exploration; cranking handle fabrication; Icon.
Yihan Tang - NeoPixel connection; Box surface design and fabrication; Card design perfection, NeoPixel holder & box body fabrication; video retouch
Advisor: Stefania Druga – Hacking Smart Toy for AI Learning
Special Thanks: Daniel Shiffman, Tom Igoe and the ITP residents who provided insight and expertise that greatly assisted our research and technical issues.
ACHIEVEMENT
Design & Research
1. 3 iterations of functional prototypes
2. ~ 50 children playtest participant
3. ~ 100 teens & adult playtest & feedback.
4. ~ 20+ expert review and insight
Technology
1. Crank interaction to MIDI signal and NeoPixel
2. Card Insert to MIDI USB
Research Paper – CHI PLAY 2019:
Published in ACM CHI PLAY '19 Extended Abstracts Exhibition at CHI PLAY 2019 in Barcelona, Spain
Not Included
1. Experience research of human voice pitch detection to MIDI notes (AI) – updated on Oct 2019
2. The appearance design of humming box (for children)
3. Tangible Interaction of hum to midi (now is web-based)
WEB AI INTERACTION (Recent Update)
As of Oct 2019, thanks to our amazing technical expert Chunhan's hard works, our project achieved an AI-powered pitch-detection feature through a web-based service – which allows our users to sing/hum a melody and crank out their own creation of music.
01. OVERVIEW
A product that empowers children's ability to compose and perform music.
OVERVIEW
Music education benefits children's mental and intellectual development in early childhood.
Guided by child-centered design principles, we propose "Humming Box", an AI-powered tangible music toy for 4-6-year-old children. The main goal of our project is to blend traditional hand crank music boxes with software-based music manipulation and create new possibilities for children to create and remix music manually.
Our project presents findings from 3 design sprints; each demonstrating playtest results and new design iterations. The user evaluation of our final design suggests that multimodal musical creation leads to increased engagement. We also discuss how the modular design of our toy's functional components encourages creative expression and cooperative play.
PROBLEM STATEMENT
Main Challenge
Traditional music composing training presents a higher barrier of entry due to additional cost, time, money, and effort in fundamental music education.
How can we provide a tool for young children to encourage their music composition passion without a steep learning curve?
Supplement Challenge
Children's increasing screen time and monotonous interaction habits in the digital era raised our concern.
Read more about effects of screentime on the health and well-being of children.
