Posted on

Vedant’s status report 4/29/2023

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week I was helping Sachit get the web application working. We decided to work on it together since I have prior experience with Django and this would probably make integration easier.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Our progress is on track to be done by the demo

What deliverables do you hope to complete in the next week?

In the next week, I hope to integrate my generative music model with the web app interface

Posted on

Team status report 04/23/2023

 

  • What are the most significant risks that could jeopardize the success of the project? How are these risks being managed? What contingency plans are ready?

The biggest risk to the project is still the quality of generated music. Although the quality of music generated by the pre trained model is good, It’s hard to predict how the finetuning will affect the generated music. To mitigate this risk we’re researching different techniques used when fine tuning models (such as freezing certain weights) to prevent divergence.

  • Were any changes made to the existing design of the system (requirements, block diagram, system spec, etc)? Why was this change necessary, what costs does the change incur, and how will these costs be mitigated going forward?

The overall design of the system remains the same.

  • Provide an updated schedule if changes have occurred.

No changes

Posted on

Vedant status report 04/23/2023

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week a lot of time and effort was put into pivoting the implementation of the generative music model. After training a transformer model from scratch I quickly realized that given the time and resources I wouldn’t be able to get the results I need training a model from scratch. Following this I decided to use a pretrained model as a starting point and finetune that model for the different genres we presented in our use case requirements. I decided to use the pop music transformer (https://github.com/YatingMusic/remi) as a starting point and fine tune this model with files from the Lakh MIDI dataset segmented by genre.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I feel that my progress is on track, using a pretrained model means that models would need far lesser training time which makes up for this pivot.

What deliverables do you hope to complete in the next week?

Fine tune the model on the different datasets for the different genres.

Posted on

Team Status Report 04/08/2023

  • What are the most significant risks that could jeopardize the success of the project? How are these risks being managed? What contingency plans are ready?

Right now the biggest risk seems to be that the quality of generated music isn’t up to par. We have a few ideas to combat this we are going to discuss with Professor Sullivan.

  • Were any changes made to the existing design of the system (requirements, block diagram, system spec, etc)? Why was this change necessary, what costs does the change incur, and how will these costs be mitigated going forward?

We are now planning to have our web application compatible with mobile phones, this doesn’t incur additional cost as we were already planning to use bootstrap for our front end which dynamically sizes content.

  • Provide an updated schedule if changes have occurred.

No changes

Posted on

Vedant’s status report 04/08/2023

  • What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I met my goal for the interim demo which was to have an end-to-end pipeline working for music generation. Training the model took a long time, and I was listening to output samples to see what the model did well and what it didn’t.

  • Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Progress is on schedule, now that I have a working pipeline, I need to train three different models for the three different genres.

  • What deliverables do you hope to complete in the next week?

I plan to discuss possibly fine-tuning a pre trained model with Professor Sullivan, and based on that finding techniques to have the model perform better than it currently is.

  • Now that you are entering into the verification and validation phase of your project, provide a comprehensive update on what tests you have you run or are planning to run. In particular, how will you analyze the anticipated measured results to verify your contribution to the project meets the engineering design requirements or the use case requirements?

This is something I have recently been doing research on, initially, the plan was to use metrics such as tonal distance between the generated MIDI and input MIDI, and the percentage of empty bars generated. But I recently came across a research paper that explored other metrics. I will discuss with Professor Sullivan before finalizing

Posted on

Vedant’s status report 4/1

 

  • What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).
  • Built on the notebook I had in place from last week. Included data loading and processing and currently working on having the model trained by the interim demo on a smaller dataset
  • Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule? 
    • Progress is on schedule. Once the end to end workflow is completed for the interim demo the same will have to be repeated for the different genre datasets
  • What deliverables do you hope to complete in the next week?
    • Aim to train the model on one genre to have it working by the interim demo
Posted on

Vedant status report 3/25

  • What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).
    • Completed a jupyter notebook with a complete model declaration, optimizer set up and training loop
  • Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule? 
    • Progress is on schedule but the dataset is proving a little difficult to work with
  • What deliverables do you hope to complete in the next week?
    • Aim to train the model on one genre to have it working by the interim demo
Posted on

Vedant Status Report 03/18/2023

What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I’ve been working on completing a complete project workflow in a jupyter notebook. I have downloaded the dataset and have been conducting EDA (Exploratory Data Analysis). Have installed and imported all the libraries necessary to preprocess the data. Will work on segmenting the dataset into different genres using the metadata files. Mainly been working with pandas and the dataset.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule.

My progress is on schedule

 

What deliverables do you hope to complete in the next week?

I aim to have a complete workflow set up, and a first attempt at training the model

 

Posted on

Team status report for 03/11/2023

  • What are the most significant risks that could jeopardize the success of theproject? How are these risks being managed? What contingency plans are ready?
    • The risks remain the same as last week and they are being managed the same
  • Were any changes made to the existing design of the system (requirements,block diagram, system spec, etc)? Why was this change necessary, what costsdoes the change incur, and how will these costs be mitigated going forward?
    • No changes were made
  • Provide an updated schedule if changes have occurred.
    • No changes
  • As you’ve now established a set of sub-systems necessary to implement your project, what new tools have your team determined will be necessary for you to learn to be able to accomplish these tasks?
    • Implement binning stft with constant q transform
Posted on

Vedant’s status report for 03/11/2023

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week was mainly spent working on the design report. working on getting the design report as polished as possible took most of my time this week

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

The design report took more time than I had anticipated, and I was busy with other work during the break so I was unable to catch up. I believe I am about a week behind schedule. The coming week is pretty light in terms of work so I plan to catch up.

What deliverables do you hope to complete in the next week?

The main deliverable I want to achieve next week is having an end-to-end workflow ready using a pre-built GPT