This week, our focus was on finalizing our project idea, ironing out various details and working on the proposal presentation. Early on, we had already finalized our idea of a smart-fridge add-on that would use computer vision (CV) to keep track of fresh produce going in and out of the fridge, and remind users + suggest recipes accordingly. The key technical challenges of our project would be the CV system, database system and overall workflow between the two and the intermediate UI.
Through a combination of thinking our project through and Prof Marios’ advice, we note some of the following details that we needed to iron out:
- Choosing the right CV algorithm: Finding several appropriate CNN networks and/or classical methods to use, and testing each one for accuracy to benchmark speed, accuracy and other metrics
- Image Segmentation/White background for the CV algorithm: Some of the classifier networks that we initially found need a white background to work well. To overcome this, we are currently thinking of a little platform that involves a little white ‘screen’, which the user will place the fruit on.
- UI: We are thinking of putting together a vanilla bootstrap website since the UI does not need to be particularly advanced. This will let the site run quickly.
- Database System: We need to find a database system that will integrate well and easily with our back-end, and is sufficiently scalable for the project.
- Back-end: We are thinking of building our back-end upon Node.js and Express, as the JavaScript framework and widespread availability of libraries make it much easier to avoid rewriting common boilerplate code and enable us to focus on writing code specific to our project. However, more research and investigation should be done before we embark on back-end development. We will also iron out our API design, which will help guide our choice of back-end architecture.
With this, we completed our proposal presentation on Wednesday! Overall, our hard work paid off, and the proposal presentation went very well. It seemed that we were on track, and our next stage was to begin our research and prototyping process, which we are currently halfway through on.
This document summarizes what we are currently planning for the architecture and how each component fits together (including documentation of API endpoints): Architecture