Author: yezheng

Personally, I focused on the work of the design review report.  After reviewing more related works and analyzing the ingredients that might result in high recognition accuracy and lower false cases, I built a table of ingredient candidates that we might count as the final 10 items that we will be recognizing and relating recipes to. The table is attached in the post.

In addition, I learned about the current popular recommendation systems and how to build them from scratch. I followed these tutorials: https://www.toptal.com/algorithms/predicting-likes-inside-a-simple-recommendation-engine and https://www.analyticsvidhya.com/blog/2018/06/comprehensive-guide-recommendation-engine-python/ to help me design the algorithms for a small scale recommendation system.

I am in the right place of the schedule we planned and not behind. For the deliverables for next week, we will first finish up the report together, and next personally I will be focusing on grabbing the recipes related to the candidates listed in the table and finalize our 10 items on the list and 30 recipes as well.

One of the most significant risks that could harm the success of the project is that we may have to work separately in order to make sure that different tasks can be tackled at the same pace. We will manage the risk by ordering two pieces of the same hardware parts so that we will be able to do our own work at the same time. The hardware parts will not be wasted because there is the possibility that we will add a second layer to our fridge so that we will use two hardware pieces.

Another risk that we currently met is that even though we order all parts using the form last Sunday and expected that the orders would have been placed on Tuesday, we did not know that we needed to inform TAs in order for the orders to be confirmed. Thus, we didn’t get the orders placed until Friday, which may influence our schedule. Fortunately, our models and codes will not be run on jetson Nano until we tested them on PC, so the delay in these parts will not be a big problem. For the acrylic boards and the LED grids, we will try to work on the building work together to shorten the time we need for this part of the work.

In general, we do not have any changes to our proposed schedule. This week we worked on the design review presentation together, and we tried to specify the implementations of the software part and support our ideas with related works and details. We also decided on the bill of materials and placed the orders. For the next week, we will work on the design review report and start working on our own tasks as planned.

 

This week I worked with my teammates on the design review presentation. Personally, I first worked on the schematic diagram. I simulated the ideal product in the real-world application by renovating my own fridge, taking a photo of this real fridge, and adding components to the photo(below shows the photo in the process; the final pic exceeds the 8Mb limit and will be displayed in presentation). In addition, I also sketched a diagram of how our final product for proof of concept will look like.

For the recommendation system, I read many related works available online and some popular implementation of recommendation system training networks. From all articles and works, I found a paper that focused on a cooking recipe recommendation system that runs on a consumer smartphone. https://online-journals.org/index.php/i-jim/article/view/3623/3116

I compared their applications of bag of features with my previous related projects to help me build my own training models.

I think we are on the schedule planned before. For the next week, we will first focus on finishing the design review report; if I have extra time, I will start building the baseline model by first implementing the feature extraction and test on the accuracy.

 

This week I looked into the Google Cloud Vision API that we planned to use for the image recognition part. By testing on the API with different images of perishables, I believe that the API will be reliable on photos that we take for real food, as it provides high accuracy on the type of food and precision on the amount. Some example results of oranges are the following.

I think the progress is on schedule, and for the next week, I am planning to research more about the past works on recipe recommendation systems or other recommendation systems based on few features(restriction on recipes, number of people).  Also, I will work with my team on the design review presentation.

For this week I worked on the proposal slides with my teammates. I worked on user flow diagrams, proposed schedules, and solution approaches. After meeting with Prof. Sullivan this week, I made some researches on sensors that may help us recognize the items better. I think our team have good communication and for next week I will look into more approaches that can help us build a strong recommendation system.