Eli Status Report 3/18

What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

Tested gaussian filtering on entire samples, realized it adds noise over long time periods. Switched to using low pass filters. Works well.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I was hoping to accomplish more this week, I am behind now. I have enough slack to cover being behind, but I will need to make significant progress this week. I still need to implement stft windowing. What deliverables do you hope to complete in the next week?

Start to implement stft with constant q transform. Implement single stft window as first step, then implement binning stft.

Team Status Report 3/18

  • What are the most significant risks that could jeopardize the success of theproject? How are these risks being managed? What contingency plans are ready?
    • The risks remain the same as last week and they are being managed the same
  • Were any changes made to the existing design of the system (requirements,block diagram, system spec, etc)? Why was this change necessary, what costsdoes the change incur, and how will these costs be mitigated going forward?
    • No changes were made
  • Provide an updated schedule if changes have occurred.
    • No changes

Vedant Status Report 03/18/2023

What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I’ve been working on completing a complete project workflow in a jupyter notebook. I have downloaded the dataset and have been conducting EDA (Exploratory Data Analysis). Have installed and imported all the libraries necessary to preprocess the data. Will work on segmenting the dataset into different genres using the metadata files. Mainly been working with pandas and the dataset.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule.

My progress is on schedule

 

What deliverables do you hope to complete in the next week?

I aim to have a complete workflow set up, and a first attempt at training the model

 

Sachit Status Report 3/18

What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week I kept working on the ESP32 and started learning bootstrap on the side. With the ESP32, I started creating a program to record audio and try sending it over Wifi. Currently in debugging and researching stage and should be on track finish by early next week.

Also have started learning how to use Bootstrap for the frontend for the web dashboard.

Is your progress on schedule or behind? If you are behind, what actions will betaken to catch up to the project schedule.

Before spring break I had fallen sick and gotten the flu because of which I have fallen behind on the ESP32 programming as I had intend to be done by this week, I believe I realize that and aim to put a few extra hours this week to get back on schedule.

What deliverables do you hope to complete in the next week?

I intend to finish the ESP32 program and start programming the frontend design as soon as possible as it will go through iterations.

Team status report for 03/11/2023

  • What are the most significant risks that could jeopardize the success of theproject? How are these risks being managed? What contingency plans are ready?
    • The risks remain the same as last week and they are being managed the same
  • Were any changes made to the existing design of the system (requirements,block diagram, system spec, etc)? Why was this change necessary, what costsdoes the change incur, and how will these costs be mitigated going forward?
    • No changes were made
  • Provide an updated schedule if changes have occurred.
    • No changes
  • As you’ve now established a set of sub-systems necessary to implement your project, what new tools have your team determined will be necessary for you to learn to be able to accomplish these tasks?
    • Implement binning stft with constant q transform

Eli Status Report 3/11

What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I implemented gaussian filtering in my test audio generation script. It works on simple sine waves, still need to test with guitar audio samples.

I have decided on using short time Fourier transforms (stft) and rms amplitude detection for pitch and velocity detection respectively.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I was hoping to accomplish more over break, but did not end up having as much time as I thought I would. I am still on track, slightly behind. There are no unknowns in reading in guitar audio and doing pre-processing, so I do not expect that wrapping up this deliverable will take any significant amount of time.What deliverables do you hope to complete in the next week?

Pre-processing script reading in guitar audio finalized. Start to implement stft with constant q transform. Implement single stft window as first step, then implement binning stft.

Vedant’s status report for 03/11/2023

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week was mainly spent working on the design report. working on getting the design report as polished as possible took most of my time this week

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

The design report took more time than I had anticipated, and I was busy with other work during the break so I was unable to catch up. I believe I am about a week behind schedule. The coming week is pretty light in terms of work so I plan to catch up.

What deliverables do you hope to complete in the next week?

The main deliverable I want to achieve next week is having an end-to-end workflow ready using a pre-built GPT

Sachits Status 3/11

What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week I caught the flu and wasnt able to work on anything except the design report.

Is your progress on schedule or behind? If you are behind, what actions will betaken to catch up to the project schedule.

Yes I have fallen back on schedule due to illness however I intend to put in extra hours to overcome the lost time.

What deliverables do you hope to complete in the next week?

I intend to start transmitting over WI-Fi with ESP32 and also perform on-chip audio recording and also learn the Bootstrap and Django tech stack for the web dashboard.

Eli Status 2/25

What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I have started using PyAudio to read/write audio files and do some experimentation with sound generation just to see what its capabilities are.

I referenced this article:

https://plainenglish.io/blog/making-a-synth-with-python-oscillators-2cb8e68e9c3b

To see what simple signal processing/signal manipulation techniques I can use to create interesting sounds. I have the capability to read in guitar audio. I still need to ensure my preprocessing steps can be efficiently accomplished, but I do not foresee any issues with preprocessing.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I have given myself a week for preprocessing audio and a week for testing preprocessing. This means I am not too far behind, but I am hoping to spend much more time next week and have preprocessing and preprocessing testing done early next week so I can start on actual pitch detection. I did not accomplish as much I was hoping to this week (due to other work and sickness). What deliverables do you hope to complete in the next week?

Fully working and tested script to read in guitar audio, perform any noise reduction if necessary, and return the signal with note onset detection.

Team Status 2/25

Enumerate how you have adjusted your team work assignments to fill in gaps related to either new design challenges or team shortfalls (e.g. a team member missing a deadline).

To be able to effectively utilize the capabilities of the audio/esp32 board, Sachit and Eli are making time to develop a workflow for working with the board.

What are the most significant risks that could jeopardize the success of the project? How are these risks being managed? What contingency plans are ready?

The most significant risk of this project is the generative music model. If the model doesn’t generate pleasant music that would significantly affect the user experience. To mitigate these risks the first approach to building the model will closely follow the research paper  https://arxiv.org/abs/1809.04281. After we have a baseline performance with this model we will modify and optimize the performance.

Since pitch detection is being done on a platform we haven’t used before, there is a risk doing ground up pitch detection will not work as well as we hope. There are a lot of other pitch detection options if this does not work.

Since none of us have used the audio/esp32 board we got, there could be unforseen challenges with using it. If we can’t get it working this week, we will likely opt to record directly to the cloud with cell phones.

Were any changes made to the existing design of the system (requirements, block diagram, system spec, etc)? Why was this change necessary, what costs does the change incur, and how will these costs be mitigated going forward?

The design is the same, no changes made so far.

Provide an updated schedule if changes have occurred.

No changes.This is also the place to put some photos of your progress or to brag about component you got working.