Hugo Status Report 4/26

This week we had a lot of progress. I worked closely with Aleks in order to fully integrate the STT scoring into our webapp. I made some minor tweaks to our scoring in order to improve Deepgram’s performance with singing. The improvement was not significant, but it did show good signs and if I have more time I will go back and make some more changes before the demo. Aleks and I worked together to decide on the UI and actual score system and came up with a mostly final version as well as finishing up the full integration. More on my own, I have made large strides on the ESP32 functionality for receiving the bluetooth signals form the arduino. At the moment, it is capable of receiving both audio and accelerometer data, but we are having issues with actually playing the audio. The general idea (hardware wise) seems to be working, but we are currently making changes to the sample rates and sending rates between the two systems as well as the delays in writing to the DAC on the ESP32 side. My current hypothesis is that the issue relates to the buffering systems we are using, as both sides have a buffer. On the Arduino side, we are stacking up a certain amount of samples on and then sending them all in one block to be buffered out by the ESP32. The ESP32 then receives and also queues into a buffer, and outputs to the DAC on a timer. This is where the issue comes into play. Either we are sending too many samples at once, or we are writing the samples to the DAC too quickly. We are continuing to troubleshoot this now but it is the final major roadblock in our project so we are almost at the end.