Jenny Han, Bradley Zhou, Jade Wang. Carnegie Mellon ECE Capstone, Spring 2021
This week I worked on the hand gesture model and the pen. For the hand gestures, I marked the dataset and cleaned it: After that, I trained and tested the model. Here are the results: For the pen, I helped wire the accelerometer and …
This week, we made significant progress in our pen hardware. We were able to read in data from the accelerometer/gyroscope and send it to our Python code via the HC-05 Bluetooth module. Due to some library issues, we had to pivot to using Windows as …
This week, I met with Bradley and Jenny several times to make progress in our pen hardware after meeting with Professor Kim on Monday. After Bradley assembled the initial pen hardware, we all met up to help debug his assembly on the breadboard. We explored several Arduino MPU6050 libraries to get our code to read in the accelerometer/gyroscope data. After finishing that, we wired the Bluetooth piece to try and read in the data via Python code. The Bluetooth libraries available for MacOS are fairly outdated so we had to pivot several times. PyBluez, Sockets, and BLE libraries all did not work. Eventually, we resorted to pivoting to a different operating system and decided to use Windows.
Additionally, I created some initial wireframes for our GUI design using Figma:
This week, I worked on the hardware and software prototyping of the pen. First, I constructed the circuit on a breadboard, connecting the arduino, accelerometer, and bluetooth module. After ensuring the accelerometer worked and accurately reported data through the serial monitor, I explored various options …
This week, we met up multiple times to finish the design report and move forward in building our project. We got some good feedback from the professor and TA in details that our project was missing. We are doing our best to turn this into …
This week I worked on the design report and helped write the software implementation, introduction, software testing plan, schedule, and task breakdown sections. I also helped to revise and edit our report.
In terms of the project, I worked on the gesture recognizer. I got OpenCV running on my computer, found and marked a dataset I could use, and started to work on the gesture recognizer model.
Here are images of the dataset I marked.
This week, I worked on finishing our Design Report Document and turning that. Additionally, I worked on the Python script to read data from Bluetooth data from the HC-05 module. I experimented with the PyBluez library and found several complications with the library and its …
This week, we spent time together discussing, dividing, and working on the design proposal. Taking in the feedback from the presentation, we thought much more about implementation specifics, especially with the software modules interacting with each other. We spent more time researching the existing libraries …
This week, we finalized the Design Presentation Slides/speaker notes.
We met a few times to discuss the feedback we got regarding our presentation regarding content. This week, we will focus on fleshing out timing measures of the Python code and more specific definitions of inputs/outputs of the modules. Also, we split up work for our Design report and worked on that this week.
After our software and hardware specs are defined in our Design report, we will begin to build. Our hardware parts for the pen device arrived and we will begin to put together the pen this week. Also, we will begin to find and clean data for our hand position model.
This week my team and I met to discuss in detail the specs of our implementation of Magic Mice. Specifically, I helped design how the software would be laid out and how individual components would communicate with each other. I did this by doing more …