My goals before the October break are to make major strides in the feature recognition component and image preprocessing component of the project. Having changed out project goals to make our model from scratch, I am putting additional efforts into making sure our facial recognition component is fully fleshed out. Here are some of the things that I did this week that constitute my effort toward this goal:
- Creating a facial recognition architecture to run quickly
- Draws a bounding box around the face of the conversational partner
- Currently working on potentially isolating the eyebrows, lips, and eyes of the partner as these are seen to be the most indicative of the emotion
- Likely to try this programmed-in feature recognition as well as getting the model to recognize these patterns by itself.
- Connected the camera to my PC which with the help of OpenCV enabled me to process video in real-time
- Allows for the initial attempt to draw the bounding box, although it was not very reliable as I believe my image pre-processing is incorrect with the size and resolution of the images
- This is my next goal for early this week
- Allows for the initial attempt to draw the bounding box, although it was not very reliable as I believe my image pre-processing is incorrect with the size and resolution of the images
- Look into both the RFB-320 facial recognition model and VGG13 emotional recognition model
- I believe I will be creating variants of these models
Goals for next week:
- Potentially submit an order for a more reliable Logitech camera as this one has been giving me issues
- Keep working on the facial recognition and preprocessing to ensure the emotion recognition model can grow properly on top of that