Key Stroke

Project Status
In Progress
Comment Count
2 Comments
Difficulty
Difficulty

Here's a list of everything we used in this project:

1/8th in acrylic sheet

rubber bands

3mm diameter steel rod, ~ 9in long

A lot of super glue

Adafruit feather basic proto, any arduino with 13 GPIO pins should work

Adafruit feather ESP8266, this board worked great but a similar wifi compatible board or breakout should work too

12 pushbuttons

14 10k Ohm resistors

Wire to connect them, we used 3 colors for ground, power, and signal

Small speaker, need a real speaker not a piezo buzzer

 

Skills Overview

We used a lot of skills to complete this project. Some we knew, some we learned along the way. Here's a few:

2D CAD

Soldering

Circuit design

Arduino Wiring

Arduino Programming

i2c communication

Using the ESP8266 to communicate to a webserver

Frontend design

"3D, sinusoidal waveforms on a mesh of points, complete with time evolution and dampening"

 

 

The Challenge

"Fitbit for piano"

We set out to design a platform to provide data analytic feedback to people learning piano. We divided the project into 4 main parts: The physical construction of a keyboard, circuit design for real time feedback and data transfer, programming that microcontroller system, and the webserver to display and track your progress. This project was completed in 24 hours at this years Makeathon!

Construction (Jake)

Although we could have modified an electric keyboard, we wanted the ability to customize it for the project, and thought that it was more true to the makeathon spirit to build it from scratch. The chassis and keys were all designed and lasercut out of cast acrylic. The walls all had slotted connections that were then glued together, and the keys are made up of layers of acrylic. The keys were then connected on a steel rod acting as the fulcrum, with rubber bands in the back to act as a counterbalance and to provide tactile feedback for the keys.

One of the best decisions we made in building this thing from scratch was to make a prototype out of cardboard. At the time it felt like a bit of a waste of time, but as we set it up we realized all the mistakes we made in the design. In the end it saved us so much more time because we were able to fix the issues before they even happened!

Circuit (Jack)

The main goal of the electronics was to sense when the user pressed the keys and send this data to the webserver for processing. We did this by wiring up 12 pushbuttons, one for each key, and setting up one adafruit feather to monitor them. Then we set up the Feather ESP8266 to communicate with the first feather over i2c, and send that data over to the webserver. We connected a 10k Ohm pullup resistors to each line. Finally we hooked up a small speaker to provide audio feedback just like a real keyboard, and wired this to the one remaining pin on the button feather. This system worked really well, and leaves us a lot of room to expand in the future by adding more devices to the i2c bus.

Arduino Code (Sam)

The job of the arduino code was to integrate all of the electrical hardware and communicate to the webserver. To read the buttons we polled all of the buttons on a loop and passed it on to the wifi feather. This was done over i2c both to save output pins, and to open up the system to expansion later on, as we can chain several devices to send data over the same bus. Then we had to write separate code for the wifi feather, which had to integrate reading from the i2c bus with sending data packets to the webserver. You can check out our arduino code on the Github! 

https://github.com/SpaceProtocol/KeyStroke/tree/SCobado-Arduino

 

Web Server (Luca)

For the web application, we used a Node.js web application framework called Express to deal with communication between the Arduino ESP8266 WiFi shield and the backend. The frontend was made with custom HTML & CSS and Javascript. It detailed a welcome/home page, a data page, which displayed data collected from the hardware as well analysis of said data, and a visualization page, which used a cross-browser javascript library called Three.js to display keypresses as 3D, sinusoidal waveforms on a mesh of points, complete with time evolution and dampening. Check out the code on Github! 

https://github.com/SpaceProtocol/KeyStroke/tree/SpaceProtocol-frontend 

Thank you for creating this project, Jack. Let me know if you need help promoting it.