We hope our project will inspire composers and other musicians to explore novel methods of music composition. What's next for Talking Pianoįor future development, we plan to have real-time online recording, more instruments besides the piano, and more visualizations like a piano keyboard. We've also learned about connecting front-end to back-end web server. We've learned about audio signal processing in-depth. As passionate musicians, we are also proud of connecting music with technology. We accomplish most of what we've set out to do and learned a lot in the process. The amount of note grouping and the number of simultaneous notes are tunable parameters that the user can interact with on our website. To make the music more playable by a human, we group similar repeated notes into a single long note. One interesting example of a challenge is here, where we see many repeated notes. There were many challenges that we had to overcome, including picking a suitable time window, number of frequency bins, and conversion of intensity to key volume. As an output, we generate a midi file, mp3, pdf of sheet music, and a cool piano roll visualization of the music. We repeat this process for each time step in the audio. Then we convert these frequencies to piano keys, and we assign the key’s volume based on the sound intensity. From the spectrogram, we take a time window and pick the most prominent frequencies. Now let’s look at the structural design of this software. We then extract the optimal frequency combinations into keys on a piano keyboard to produce piano music. A spectrogram separates sound intensity (bright/dark colors), and frequency/pitch (y-axis), and maps them as a function of time (x-axis). We use a technique called short window fast Fourier Transform to map the human voice into a spectrogram. After the conversion, the user can access three different representations of their new piano voice: they can listen to the piano audio, watch an animation of the piano roll, and view the sheet music. Then in real-time, our system processes their voice and converts it into piano music. The user first uploads their voice and sets the parameters. We designed an elegant, modern, user-friendly web-based app that convert audio to piano music. In the era of digital music today, we now try to raise this analogy of sound with a more rigorous and algorithmic level to convert human speech into a piano composition. In fact, a lot of composers got their music ideas from the way people and nature talk.įor example, the French composer Messiaen was even inspired to convert bird songs into the piano. Of course, the idea of a piano talking back to you might be creepy.Īs a group of four out-going musicians in quarantine, we are now comfortable with this idea of talking to a piano. Find many great new & used options and get the best deals for Vintage Music T-shirt 88 Keys 10 Fingers No Problem Piano Short Sleeve Sz M at the best online. Instead of a cat voice, what if we try to mimic the human voice with the sound of a piano. We may still remember the Talking Tom App which ignited the internet in 2010.
0 Comments
Leave a Reply. |