Carnegie Mellon ECE Capstone, Spring 2024 | Kelly Cha, Michael Crotty, Sebastian Peralta
Work Accomplished: Integrated OpenAI API to get recipe using current inventory Connected the results from the filter options (Dietary Restrictions & Cuisine) Prompted the LLM and asked to end the recipe with !!! since there was a problem earlier where some long recipes are cut …
Weekly Accomplishments Trained YOLOv8 model which ran on my old laptop for almost a full week. Training results show 99% accuracy which is a tad worrysome with overfitting, but we’ll cross that bridge when we get there. Booted Kria KV260, updated packages, and launched server …
Weekly Accomplishments Figured out how to make POST Requests work Adding and Removing from SQL Database now functional Execute Post Request from Client: Post Request Processed in backend program Database Commits changes pushed by backend program Added Recipe Database Table and all functions related to …
Work Accomplished: Made the video button direct to a page that will stream the video feed from the scanners. Added a back button that goes back to the inventory page. For now UI displays “Camera is not active” but once the server is set up, …
Risks: Kria KV260 acceleration documentation doesn’t seem the most up to date Changes: Using ChatGPT instead of Llama2 or Gemma ChatGPT has more variety of recipes while Llama2 and Gemma do not work as intended, and we do not have enough time to fine-tune and …
Risks: Video streaming is still too slow. We may want to change to a better processor like RPi 4. Changes: Switching to single item classification because new database is too large to manually label. Progress: YOLOv8 model training started. Recipes page app UI completed. Researched …
Weekly Accomplishments: GET Requests for FastAPI up and running Able to query all tables in Sous-Chef DB Added Recipes Table Need to figure out what to do with Image types (if we will have images on separate BLOB storage) API performs: GET /info/ – pulls …
Weekly Accomplishments Conducted research into libraries that allow for video streaming over wifi. Implemented a new stream that has improvement (6s/frame) over last week’s implementation (10s/frame), but still is quite slow. There’s one last hope with a library that uses FFMPEG that may allow for hardware …
Work Accomplished: Worked on the UI of the Recipes page Figured out a way to customize the tabs to be what I want Made the Sort By buttons a customized radio button so that it toggles. (followed this example: https://blog.logrocket.com/create-and-customize-flutter-radio-buttons/) Reused this widget so that it …
Risks: Video streaming is too slow. Switching to using a python library, hopefully the RPi Zero’s can handle it. Found online image dataset of produce that isn’t labeled for detection, just classification. Considering if switching to classification may be better for finishing on time. Changes: …