Jade Wang’s Status Report For 4/24/2020

This week, I worked on automating the hand gesture recognizer so that users can add new gestures and map them to user macros. The program now will take in the new gesture readings and automatically train the model immediately. The program then restarts automatically so that the user does not have to do anything besides enter in gesture snapshots via keyboard presses, and labels for the new gesture and which user macro they want to map the gesture to. Jenny has made progress on the GUI this week as well, so I was able to link the gesture recognizer program with the GUI such that the user can start up the program by using the GUI.

Next week, I will work with Jenny to finish linking the GUI and recognizer fully such that the user can control the recognizer fully from the GUI and keyboard inputs. Below are screenshots of our GUI. Pressing the ‘start’ button starts the recognizer in training mode immediately so user can enter in hand gesture snapshots via keyboard command.