Wendy’s Status Report for 04/02/2022

This week, I worked on mapping user events to keyboard actions like we had originally planned (eg. left wink maps to Siri activation and right wink changes the mode of the arrows from left/right to up/down). For this week, I had planned on moving the keyboard from just a Python window to something accessible on laptop applications, including the Notes app or on Chrome. However, this is a more difficult task than I originally thought and I was not able to get that working this week. I am going to have to think about how I would set the keyboard to start inserting keys based on simulated key presses (in other words, whether the user can start typing immediately after opening an application or if they have to use the cursor to move to a typable location, double click to get the blinking started, and then hover over the keyboard to start typing). I have looked into ways to make the keyboard accessible on any laptop application, including using Pynput to simulate mouse clicks and keyboard strokes. Therefore, I am a little bit behind schedule but I plan on getting a keyboard to appear and work with the user events by next week. For now though, what I have done with the keyboard interface is good for our demo in a couple days.