Introduction Post and Summary

Problem Statement

There are many times students and instructors need to utilize the Zoom Whiteboard feature, but they do not have tablets, iPads, or touchscreen to easily draw. Using the mouse is both clunky and slow, turning people off from this useful feature of remote meetings.  

Our Solution/Implementation

Our Whiteboard Pal uses Machine Learning to identify gestures and computer vision to allow users to accurately draw on the screen by tracking the user’s fingers and hand.

We will use opencv, the computer vision module, to track the user’s pointer finger on camera and accurately reflect it on screen with the mouse as the user moves their hand around.

To detect whether the mouse is being pressed or held down, we offer the option of the user performing a gesture to indicate it, or pressing and holding down a keyboard key at the same time as the user is moving their hand.

ECE Areas

Software Systems + Signal Processing