Posted on

Team Status Report 04/08/2023

  • What are the most significant risks that could jeopardize the success of the project? How are these risks being managed? What contingency plans are ready?

Right now the biggest risk seems to be that the quality of generated music isn’t up to par. We have a few ideas to combat this we are going to discuss with Professor Sullivan.

  • Were any changes made to the existing design of the system (requirements, block diagram, system spec, etc)? Why was this change necessary, what costs does the change incur, and how will these costs be mitigated going forward?

We are now planning to have our web application compatible with mobile phones, this doesn’t incur additional cost as we were already planning to use bootstrap for our front end which dynamically sizes content.

  • Provide an updated schedule if changes have occurred.

No changes

Posted on

Vedant’s status report 04/08/2023

  • What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I met my goal for the interim demo which was to have an end-to-end pipeline working for music generation. Training the model took a long time, and I was listening to output samples to see what the model did well and what it didn’t.

  • Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Progress is on schedule, now that I have a working pipeline, I need to train three different models for the three different genres.

  • What deliverables do you hope to complete in the next week?

I plan to discuss possibly fine-tuning a pre trained model with Professor Sullivan, and based on that finding techniques to have the model perform better than it currently is.

  • Now that you are entering into the verification and validation phase of your project, provide a comprehensive update on what tests you have you run or are planning to run. In particular, how will you analyze the anticipated measured results to verify your contribution to the project meets the engineering design requirements or the use case requirements?

This is something I have recently been doing research on, initially, the plan was to use metrics such as tonal distance between the generated MIDI and input MIDI, and the percentage of empty bars generated. But I recently came across a research paper that explored other metrics. I will discuss with Professor Sullivan before finalizing

Posted on

Sachit’s Status Report 04/08

  • What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I met my goal for the interim demo by finishing the workflow for guitar recording using ESP32 and transmitting over WiFi. After the demo, the comments revolved around integration. I integrated signal processing along with the communication so once the wav file is generated in the backend it can be converted to MiDi ready for the ML model. I also changed my tech stack to use basic HTML and CSS for the frontend as bootstrap was overkill for such a basic dashboard. Similarly for the backend as it is handling no state and just routing basic requests, I will be using flask instead of Django.

  • Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Progress is on schedule and I intend to finish frontend by next status report and then backend and integration in the last week.

  • What deliverables do you hope to complete in the next week?

The frontend and make it more responsive and meet our demands.

  • Now that you are entering into the verification and validation phase of your project, provide a comprehensive update on what tests you have you run or are planning to run. In particular, how will you analyze the anticipated measured results to verify your contribution to the project meets the engineering design requirements or the use case requirements?

For the audio recording as I am using TCP there is no loss of packets. However I have been testing whether the bandwith is able to send the whole audio before the communication is shut down. Secondly for the dashboard as there is no inputs other than buttons, there is not much testing to be done. I will be hardcoding the workflow we expect the user to follow to prevent any erroneous inputs.

Posted on

Eli Status 4/1

What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

Finished ESP32-A1S bringup. Audio streaming from board done.

Have windowed stfts done. Still need to ensure precision and accuracy of determined fundamental are good. Requires bin size tuning and ensuring the parameters of the transform are well suited for clean tone electric guitar recordings.

Performed filtering of static noise. Able to remove most common electric guitar noise.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Almost back on schedule. As long as I have pitch detection for the interim demo, I will be on track.What deliverables do you hope to complete in the next week?

Read fundamental pitch from analyzed guitar notes, perform testing to ensure accuracy.

Posted on

Team Status 4/1

  • What are the most significant risks that could jeopardize the success of theproject? How are these risks being managed? What contingency plans are ready?
    • The risks remain the same as last week and they are being managed the same
  • Were any changes made to the existing design of the system (requirements,block diagram, system spec, etc)? Why was this change necessary, what costsdoes the change incur, and how will these costs be mitigated going forward?
    • No changes were made
  • Provide an updated schedule if changes have occurred.
    • No changes
Posted on

Vedant’s status report 4/1

 

  • What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).
  • Built on the notebook I had in place from last week. Included data loading and processing and currently working on having the model trained by the interim demo on a smaller dataset
  • Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule? 
    • Progress is on schedule. Once the end to end workflow is completed for the interim demo the same will have to be repeated for the different genre datasets
  • What deliverables do you hope to complete in the next week?
    • Aim to train the model on one genre to have it working by the interim demo
Posted on

Sachit’s Status Report 4/1

What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week I finished working with the ESP32 where I established a server on the ESP32 to receive the wav file of the audio recording over WiFi. Also finished a basic python client for the server to receive data from the ESp32 and control it based on user input. I also completed a basic version of the frontend for the interim demo.

Is your progress on schedule or behind? If you are behind, what actions will betaken to catch up to the project schedule.

I expected the ESP32 programming to take much less time however it occupied most of my time these past few weeks. However the server and frontend turned out to be simpler which led me to manage my schedule.

What deliverables do you hope to complete in the next week?

I intend to start working on the Django backend and integrate the ML and signal processing done by Eli and Vedant.

Posted on

Vedant status report 3/25

  • What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).
    • Completed a jupyter notebook with a complete model declaration, optimizer set up and training loop
  • Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule? 
    • Progress is on schedule but the dataset is proving a little difficult to work with
  • What deliverables do you hope to complete in the next week?
    • Aim to train the model on one genre to have it working by the interim demo
Posted on

Eli Status Report 3/25

What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

Started ESP-A1S bringup. Might need to scope more time to this as neither Sachit nor I have worked with it before. We were planning on using the Arduino IDE to aid in a quick bringup, but custom libraries are required which are not compatible with our board. Therefore we have to use the ESP-IDF/ADF and completely bring up the board with networking and LINEIN interaction.

Went through radix-2 FFT and other time saving fourier transform algorithms. Have a firm grasp on overlap add and overlap save reconstruction methods.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Still behind where I was hoping to be. Might need to reduce scope. Will have better grasp on scheduling after this week.What deliverables do you hope to complete in the next week?

Implement single window stft. Apply to single guitar notes. Report frequency content.

Finish ESP-A1S bringup for audio portion.

Posted on

Team Status 3/25

  • What are the most significant risks that could jeopardize the success of theproject? How are these risks being managed? What contingency plans are ready?
    • The risks remain the same as last week and they are being managed the same
  • Were any changes made to the existing design of the system (requirements,block diagram, system spec, etc)? Why was this change necessary, what costsdoes the change incur, and how will these costs be mitigated going forward?
    • No changes were made
  • Provide an updated schedule if changes have occurred.
    • No changes