This week, along with completing our design presentation, I focused on both ordering the harware and software integration for our project. On the hardware side, I placed orders for key components including the ESP32 microcontroller, an IMU (Inertial Measurement Unit), and capacitive touch sensors. After more research, I also identified and ordered a secondary back-up IMU that meets our project requirements and has much resources on documentation and usage online, which should help speed up integration and troubleshooting.
On the software side, I successfully integrated the MediaPipe hand tracking program with our frontend HTML interface. The system can now detect a left hand in real time through the web application, providing a foundation for finger chord selection. The next step will be to identify which specific finger is being selected. Once finger-level detection is implemented, we can start playing different notes of a chord.