Flappy Bird with Sound

Youmingzhang
Nov 13, 2020

Idea

This week I explored ml5 and sound library in p5. I came up with this idea to control my flappy bird game using a voice rather than a mouse. I tested ml5’s model and its speed to say “up” “down”. I will use “up” to fly the bird in the game I created previously.

ML5

The classifier I used is soundClassifier which can detect “up”. After successfully detects speech. I tuned my parameters for the bird class and pipe class to make the game playable.

Result

It is so hilarious to play the game this way. I have to constantly say “up” and my mouth is kind of sour after sometimes. If people did not realize I am playing a game they will think I am a crazy person lol.

Teachable Machine

I also tried to build my own model using google’s teachable machine but ml5 had some error loading my model. This is the bug I don't understand and could not figure out.

--

--