Please list the particular ECE courses (if any) that covered the engineering science and mathematics principles your team used to develop your design? If there are no courses please tells us how you learned those principles over the last week?
I am currently taking Digital Signal Processing (18491). Along with an understanding of the basic signal processing ideas I already have, I researched common ways to do pitch detection. My research is below.
What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).
I researched my component of transcribing a monophonic guitar into midi. I researched two avenues of this, real time conversion of guitar audio to midi and doing the transcription from a recording (non-real time).
Real time pitch tracking methods and analysis:
http://www.music.mcgill.ca/~ich/classes/mumt611_05/Presentations.old/mumt614pitchtrack.pdf
https://www.cycfi.com/2017/10/fast-and-efficient-pitch-detection/
https://ccrma.stanford.edu/~pdelac/research/MyPublishedPapers/icmc_2001-pitch_best.pdf
I also spent time looking into how to make midi more expressive. Namely supplying meaningful velocity data. Roger Dannenberg has a great paper on this with comparisons of different synth’s velocity and a breakdown of a technical approach for velocity detection.
https://www.cs.cmu.edu/~rbd/papers/velocity-icmc2006.pdf
I also found an interesting master’s project which turns the voice into a midi controller. It implements this via a VST plugin. This seems like an interesting route, but does not apply for non-real time audio to midi conversion:
https://scholarworks.uark.edu/cgi/viewcontent.cgi?article=1013&context=eleguht
and a guide for VSTs:
https://integraudio.com/best-tools-to-develop-vst-plugins/
Another PyAudio midi resource:
https://python.plainenglish.io/build-your-own-python-synthesizer-part-3-162796b7d351
Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?
I am on track, I have a good idea of the use case/design requirements and how I will attempt to meet them in creation of a non-real time audio to midi transcription program using the resources I have collected above.
What deliverables do you hope to complete in the next week?
I hope to order an amp and adc and start development of a PyAudio program which can record a guitar input (keeping in mind the program will need to run on a rasberry pi.