This week, we continued the road towards integrating towards our final project. William worked on thresholding for the paddle using the IMU, and has found reliable trends that we can use to discretize the swings into a few different categories. The plan is now to send a notification from the game engine to the paddle system through bluetooth as to when the swing tracking window begins, and then for the paddle to respond to the game engine with whether the swing connected and what type of swing should be recorded.
Now, the integration that needs to be done involves setting up a reliable connection with bluetooth, and then sending the aformentioned data between the paddle and game engine. We also need to see how the latencies affect transmission, so that we can tune the parameters as to how much of a buffer we need to allow for real-time transmission of the swing result. Once we work those out, we can gather the data on the raspberry pi to determine the swing type.
As for the CV, we are planning to leave that out until we get the IMU system integrated, as the CV is behind on the testing and integration onto the Jetson. If we get the IMU up and running soon, then we can consider re-integrating the CV.