Author: smgoyal

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I have completed the frontend and started working on the backend.  Here I have attached a video of using the web dashboard with a normal user workflow.

https://drive.google.com/file/d/1e96onx2QcJHEMMVPJVD5GcPxBSgLwNwe/view?usp=sharing

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I am on schedule.

What deliverables do you hope to complete in the next week?

Finish the backend in flask and integrate it with the frontend. Also complete the whole system workflow by integrating the ML inference into the backend. Perform some stress tests and user tests to improve dashboard.

• What did you personally accomplish this week on the project? Give files or
  photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I met my goal for the interim demo by finishing the workflow for guitar recording using ESP32 and transmitting over WiFi. After the demo, the comments revolved around integration. I integrated signal processing along with the communication so once the wav file is generated in the backend it can be converted to MiDi ready for the ML model. I also changed my tech stack to use basic HTML and CSS for the frontend as bootstrap was overkill for such a basic dashboard. Similarly for the backend as it is handling no state and just routing basic requests, I will be using flask instead of Django.

• Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Progress is on schedule and I intend to finish frontend by next status report and then backend and integration in the last week.

• What deliverables do you hope to complete in the next week?

The frontend and make it more responsive and meet our demands.

• Now that you are entering into the verification and validation phase of your project, provide a comprehensive update on what tests you have you run or are planning to run. In particular, how will you analyze the anticipated measured results to verify your contribution to the project meets the engineering design requirements or the use case requirements?

For the audio recording as I am using TCP there is no loss of packets. However I have been testing whether the bandwith is able to send the whole audio before the communication is shut down. Secondly for the dashboard as there is no inputs other than buttons, there is not much testing to be done. I will be hardcoding the workflow we expect the user to follow to prevent any erroneous inputs.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week I finished working with the ESP32 where I established a server on the ESP32 to receive the wav file of the audio recording over WiFi. Also finished a basic python client for the server to receive data from the ESp32 and control it based on user input. I also completed a basic version of the frontend for the interim demo.

Is your progress on schedule or behind? If you are behind, what actions will be
taken to catch up to the project schedule.

I expected the ESP32 programming to take much less time however it occupied most of my time these past few weeks. However the server and frontend turned out to be simpler which led me to manage my schedule.

What deliverables do you hope to complete in the next week?

I intend to start working on the Django backend and integrate the ML and signal processing done by Eli and Vedant.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week I kept working on the ESP32 and started learning bootstrap on the side. With the ESP32, I started creating a program to record audio and try sending it over Wifi. Currently in debugging and researching stage and should be on track finish by early next week.

Also have started learning how to use Bootstrap for the frontend for the web dashboard.

Is your progress on schedule or behind? If you are behind, what actions will be
taken to catch up to the project schedule.

Before spring break I had fallen sick and gotten the flu because of which I have fallen behind on the ESP32 programming as I had intend to be done by this week, I believe I realize that and aim to put a few extra hours this week to get back on schedule.

What deliverables do you hope to complete in the next week?

I intend to finish the ESP32 program and start programming the frontend design as soon as possible as it will go through iterations.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week I caught the flu and wasnt able to work on anything except the design report.

Is your progress on schedule or behind? If you are behind, what actions will be
taken to catch up to the project schedule.

Yes I have fallen back on schedule due to illness however I intend to put in extra hours to overcome the lost time.

What deliverables do you hope to complete in the next week?

I intend to start transmitting over WI-Fi with ESP32 and also perform on-chip audio recording and also learn the Bootstrap and Django tech stack for the web dashboard.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This week I attended the design review presentations and learned more about each group. Additionally, I kept working with Eli on the website dashboard design on Figma and trying to improve the interface and ease of use for users. Below is the link for the Figma design: https://www.figma.com/file/NgYIERzxk8RFzgk5p14ZKj/Untitled?node-id=0%3A3&t=IFlWXSzODiPX6mkB-0.

Moreover, I brushed up on my knowledge of distributed systems and networking to better understanding how the multiple software components should interact with each other.

Eli and I acquired the esp32 board and started interfacing with it to understand how its Wifi and audio recording capabilities were.

Is your progress on schedule or behind? If you are behind, what actions will be
taken to catch up to the project schedule?

I believe we are on schedule with the only component needed for the project already acquired. Even though, I don’t believe in being complacent and plan to finish understanding the esp32 this week.

What deliverables do you hope to complete in the next week?

I want to start learning and using Bootstrap and Django to build the web app and also finish testing the capabilities of ESP32 along with Eli. I also am to complete the design report to better understand the small details of our project.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

Having finalized our use case to be a jam tool alongside a piano accompaniment for guitar players, I moved on to designing the software components and tech stack.

1. I worked with my team members to understand how the users should interface with the dashboard and designed the website in Figma alongside with the user workflow.
2. The tech stack will comprise of a frontend in bootstrap with a backend in Django running a cloud container for the signal processing as well as ML inference.
3. I developed the block diagram for interaction between software components namely the Raspberry pi, frontend and the backend.

I also extensively worked on the design review presentation mainly the implementation and requirements.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I believe my progress is on track with the design for the frontend done and the software components ideated.  As a team we have also caught up after pivoting from our proposal presentation.

What deliverables do you hope to complete in the next week?

Next thing I need to start working on is learning to work with the raspberry pi and interfacing it with the cloud, speakers and microphone. I also need to finalize the user interface experience based on feedback. Moreover, also work on the design report and detail the software components more in depth.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I personally am in charge of the software development of the project. Initially, we were deciding to create a sound experience where I was focused on a distributed speaker system. However, after more in-depth research we have pivoted to a more user-centric project which allows budding musicians have a real time music accompaniment with ML generated music. I will focused on developing embedded code for the ras pi to communicate with speakers, cloud and a cloud microservice to allow users to control the device easily through their device and also upload a custom MIDI file for accompaniment.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Due to the pivot, I believe we are about a week behind a schedule. However we have a week for the design review and we believe we can redefine our use case requirements and schedule much faster after doing it once and catch up in term of a thorough design review.

What deliverables do you hope to complete in the next week?

Have a thorough specification of the dashboard and cloud microservice and moreover research more into chip specification which allows for cloud interaction and ml inference with ease of use peripherals.