Author: gdl2

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I fixed the flex sensors to the glove at their base using hot glue and used tape to fix them through their midsections and tip. This took some time to accomplish since I had to readjust the sensors so they would be straight to minimize strain on the sensors.

I also worked on integrating the end-to-end systems and setup demos of our independent subsystems for our presentation. Here, I added a debounce to our classifier to create a more seamless experience when performing gestures. Essentially, when a gesture is classified, a timeout is applied before the next gesture is applied to prevent the host cursor from jittering across the screen.

I also worked on the slides for the final demo and practiced speaking since I presented.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Progress is a bit behind because after integration, some parts malfunctioned (some wires detached, driver malfunctioned). However, we will resolve them this week and get the entire system working.

What deliverables do you hope to complete in the next week?

I plan to work on testing the last untested parts and work on the final report.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I configured the compute module to automatically start the system on startup, since a bug in the earlier configuration caused the program to keep crashing on startup.

I improved the gesture classification model to become more robust against random noise that was being collected by the sensors. I also addressed an edge case in the gesture classification model where pan/rotate gestures weren’t being detected if they rotated slightly while panning or panned slightly while rotating.

I also sewed 10 cloth straps onto the gloves to hold the flex sensors in place. However, after putting this together and trying it with the glove module, we discovered that it wasn’t providing enough tension for the flex sensors to pick up. I experimented with using rubber bands and tape as alternative attachment schemes and will likely stick with tape for now.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Progress is a bit behind since there were a lot of hiccups with integration, but since the integration is pretty much done, we can get started with testing this week after our presentation.

What deliverables do you hope to complete in the next week?

I plan to work on the demo presentation slides and finish testing our system.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I worked on integrating the binary packed input from the glove module with the MQTT receiver on the compute module. I also worked on integrating the compute module with the HID receiver on the computer. I also worked on refining the gesture classification model based on real values from the glove module.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Progress is a bit behind since we should be starting to test this week. I’ll ensure the end-to-end integration is completed by the start of next week so that we can spend most of next week working on testing and evaluation.

What deliverables do you hope to complete in the next week?

I plan to refine the gesture classification model more so that it can work seamlessly with the input from the glove and dispatch more seamlessly with the HID receiver. Afterwards, I plan to work on some benchmarking and evaluation.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I worked on the gesture dispatch mapping on the HID controller to work in conjuction with the gesture classification model. Specifically, I worked on code that used pyautogui to dispatch HID controls that mapped to specific gestures on Geogebra. I also built an API to make this work better with the input that comes in from the gesture classification model.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Progress is on schedule.

What deliverables do you hope to complete in the next week?

Aside from the interim demo, I plan to flesh out integration in time for the interim demo as well as more rigorously test the gesture classification model.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I worked on smoothening the output of the decision tree over adjacent windows of data. I also implemented a system to map the magnitude of the gesture to the intensity of the action being performed on the computer.

Since I finished this part relatively early, I worked with David to start implementing the functionality for the gesture on the HID side. This will work well for both of us since this is closely related to the output of the gesture classification model I have been working on.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Progress is on schedule.

What deliverables do you hope to complete in the next week?

This week, I plan to finish the gesture dispatch on the HID and integrate that with the gesture classification model.

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

This past week, I wrote code for the controller to collect and aggregate data published by the glove on MQTT. I also worked on the gesture classification model, which took some more time. I built a decision tree which analyzed the trends of the incoming data in each window to classify what gesture was being performed. Although I was not able to implement smoothing of the data and more seamless transitions between windows of sensor data, I was able to write tests for the various gestures to ensure that as the models change, we can quickly verify the correctness of the underlying logic.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

Progress is slightly behind schedule on my part because of the decision tree, so I will try to finish this before the middle of next week so I can finish all of next week’s tasks on time.

What deliverables do you hope to complete in the next week?

Next week, I plan to fully complete the code for the decision tree in terms of smoothening out recognition over adjacent windows of data. Moreover, I will establish bounds (min/max) for gesture intensity output so I can map them to the intensity of the input data.

I will also work on establishing a rapid data collection script so we can create a dataset that we can use to analyze future models without doing live testing.