Introduction and Project Summary

Our project involves building a smart kitchen assistant that tracks the user’s available items in their fridge and based on the available items and user’s preference, suggests a specific recipe to the user. The KitchenAssistant will then guide the user to different items in the refrigerator that need to be picked out to make the recipe. The full scope of our implementation involves basic computer vision to track the standard items in the refrigerator, basic speech-to-text functionality to interpret user’s preference, a software recommendation database of recipes and ingredients required, and a physical guide (LEDs) that will direct the user to the appropriate items to complete the recipe. The CV and recommendation system will need to cover the full range of standard kitchen items, while the physical guide will need to be able to correctly match up with the items selected, with feedback from the CV camera.