Introduction and Project Summary

Our capstone project aims to create a music composition system that transcribes flute performances into sheet music. This will address the challenge faced by musicians who want to capture their improvisations, rehearsals, or live performances without manually transcribing the music. The project scope includes a pipeline to process audio signals from a flute based on an inputted BPM, extracting the correct pitch and rhythm (which will be referred to as note) being played, and outputting a digital sheet music file. The implementation will focus on analyzing the frequency and pitch of the flute audio to ensure that there is a high transcription accuracy. We will wrap this pipeline into a basic web or mobile app that provides an interface for the user to play a piece and view the generated score. As a stretch goal, we hope to incorporate a generative AI feature that will suggest potential next notes to assist the composer in developing their composition.