The past two weeks I ironed out some issues that showed up with the wireless communication between the pico and the Raspberry Pi. I added functionality to the voice command algorithm such that now recipe steps are sent to the glasses when needed, and so the steps are displayed when the user is in the cooking state. I looked into making the pico wireless using BLE instead of TCP, but my code is still buggy and it doesn’t work as intended, so I will spend the next week figuring that out. In terms of integration, Michelle and I decided to use two Picos instead of 1 for the glasses to balance out, so that makes the LCD and mic/speaker code integration a lot easier. I also have been working on implementing and bringing up the speaker to take in output data from the Pi through TCP. There are a couple small issues with the Pyttsx3 library on the Raspberry Pi, but they are mainly just warnings that aren’t affecting the main functionality yet (hopefully never…). I also did the latency and accuracy testing for the voice command algorithm, including how long it takes to take in input, process it, and give the output.
Progress is on track so far, I am hoping to get the speaker working by the end of the week and also figuring out what is causing issues for the bluetooth mic integration with the pico. I want to have some more testing done on the “integration” side as well, so for example, how long it takes to have stuff show up on the LCD after being sent from the Pi, and also any potential latency that is introduced as a result of the BLE implementation.