Category: Uncategorized

 

• List all unit tests and overall system test carried out for experimentation of the system. List any findings and design changes made from your analysis of test results and other data obtained from the experimentation.

Signal Processing: ~30 samples tested, looking for pitch accuracy and onset accuracy primarily.

ML Model:

Web backend:

• What are the most significant risks that could jeopardize the success of the project? How are these risks being managed? What contingency plans are ready?

The biggest risk to the project is still the quality of generated music. Although the quality of music generated by the pre trained model is good, It’s hard to predict how the finetuning will affect the generated music. To mitigate this risk we’re researching different techniques used when fine tuning models (such as freezing certain weights) to prevent divergence.

• Were any changes made to the existing design of the system (requirements, block diagram, system spec, etc)? Why was this change necessary, what costs does the change incur, and how will these costs be mitigated going forward?

The overall design of the system remains the same.

• Provide an updated schedule if changes have occurred.

No changes

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week I started working with Vedant on the Django backend and started integrating the ML inference and signal processing.

I also tried out different communication methods for raw audio transmission from ESp32 to backend namely using UDP instead of TCP to improve audio quality. After realizing TCP was the way to go, also tried different audio recording parameter in terms of sample width, sampling rate to get best quality audio recorded.

In terms of frontend, kept improving its design and added a piano visualizer to visualize the accompaniment music.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Our progress is on track to be done by the demo

What deliverables do you hope to complete in the next week?

In the next week, I want to finish integration of Django backend with frontend.

Here is the link to our project proposal presentation!

Capstone Proposal Presentation

Experimental Listening combines a deep learning enabled generative music experience with an array of movable, networked speakers controlled by an easy to use remote control. Users have the unique opportunity to actively engage in the music by picking from one of three genres, adjusting the speakers and filtering the sound to their liking.

Welcome to Carnegie Mellon University: ECE Capstone Projects. This is your first post. Edit or delete it, then start blogging!