Jenny Han, Bradley Zhou, Jade Wang. Carnegie Mellon ECE Capstone, Spring 2021
This week, I spent time improving the pen tracking algorithm by taking into consideration acceleration data. I used the same methodology as our previous approach (application of rotation matrix + double integration) but instead limited it to a much smaller time scope. The acceleration informs …
This week, I worked with Bradley and Jenny to refine our pen tracking algorithm such that it incorporated the accelerometer data. We decided to use a weighted approach since the accelerometer data exaggerates any errors in distance calculation. I also worked with Jenny to add …
This week we improved our pen tracking algorithm by incorporating acceleration data into pipeline. Professor Kim suggested using a weighted algorithm to do this and thus, we were able to implement acceleration data in our algorithm by playing with the weights of the acceleration vs. …
This week we refined our pen tracking algorithm, finalized the GUI, and completed the calibration code. For the pen tracking algorithm, we were able to combine acceleration data, orientation data, and hand tracking from OpenCV to get a reasonable mouse position. After meeting with our …
This week, I finished fully automating the process of adding a new gesture with the GUI. The GUI page now refreshes automatically to display the newly added hand gesture and the user macro that it maps to. Additionally, we decided to alter our approach for …
This week I worked on focusing more on the orientation of the pen to better estimate the position of the cursor. I used the orientation to indicate which direction the “tip” of the pen would be facing relative to the user’s hand, which presumably would …
This week I worked on finishing automating the hand gestures with the GUI, the pen tracking with OpenCV, fine-tuning the GUI, and the accuracy of the pen. We ended up changing our plan for the pen tracking to include OpenCV hand tracking to improve the …
This week, I spent toying with the new IMU we received, the BNO055. The benefit to this IMU is it features a magnetometer and more accurate orientation readings. We had originally planned on using this new IMU alongside a software library – scikit kinematics, to …
This week we worked on the pen location tracking and the GUI. For the pen location tracking, we got a new IMU and were testing out different software elements to get more accurate readings as we were having issues with accuracy and orientation. We attempted …
This week I worked on the GUI. I finished the calibration page, main page, and add the gesture page. I am currently working on making it so users can automatically add gestures through the GUI and plan on finishing that feature by the end of …