Jenny Han, Bradley Zhou, Jade Wang. Carnegie Mellon ECE Capstone, Spring 2021
This week, I worked on automating the hand gesture recognizer so that users can add new gestures and map them to user macros. The program now will take in the new gesture readings and automatically train the model immediately. The program then restarts automatically so …
This week I worked on the GUI for the calibration and gesture recognizing page using Tkinter. I also researched more into SciKit Kinematics to understand how to integrate the new IMU with the library functions. This week I will finish the GUI and link the …
This week, I worked more on the pen tracking algorithm as well as integration with mouse movement. After observations that the kalman filter was quite slow and didn’t result in a noticeably more accurate result, I removed that for now. I also observed that the …
This, week I worked on both the pen tracking algorithm and the hand gesture recognition algorithm. For the pen tracking algorithm, I tried out a Kalman filter for the acceleration readings from the MPU6050. I tried various parameters but it seemed like the Kalman filter …
This week we worked on the pen tracking software, the gesture recognition, the GUI for the project, and linking the gestures with macros. For the pen tracking software, we updated the double integration so it would integrate over a window of past values. This wasn’t …
This week I worked on the pen tracking algorithm. I found an error in our implementation and updated it so it would integrate over the last 10 data points collected by the IMU. This still had some inaccuracy, so we decided to get a new …
This week, I worked more on the pen tracking algorithm. I implemented a multithreaded producer/consumer queue model for the software (producer is arduino sending accelerometer/gyroscope readings and consumer is taking those readings to decide where to move the cursor). We ran into the expected problem …
This week, I worked with Bradley and Jenny to improve our pen tracking algorithm. We tried several methods to ensure the accuracy of the device. However, we ran into issues with the double integration and found that the error was magnified with integration. This week, …
This week we worked on the distance module and tried to ensure the accuracy of our own device. We tried to use double integration to calculate the displacement. However, using double integration caused a lot of error which made it challenging to use the pen …