Carnegie Mellon ECE Capstone, Spring 2024 | Kelly Cha, Michael Crotty, Sebastian Peralta
Risks: Server on router, but has no wifi. App needs wifi for chatgpt. (is this still a problem ?) Changes: Scanner case has a new angle so it points more downwards Progress: Got notifications to work Video feed on the app Finishing up all the …
Risks: Camera feed real time streaming directly on the Flutter app might not work. Possible options: Use a streaming platform that is made to display live videos on Flutter Get a raspberry pi video screen to display the video from the scanners and mount to …
Risks: 2GB Jetson Nano lost support in 2023, and so some of the software is fairly out of date (For example, Python 3.6 was the latest version available to be installed through apt, however Python 3.10 is the minimum version for YOLOv8) Changes: Switched back …
Risks: Kria KV260 acceleration documentation doesn’t seem the most up to date Changes: Using ChatGPT instead of Llama2 or Gemma ChatGPT has more variety of recipes while Llama2 and Gemma do not work as intended, and we do not have enough time to fine-tune and …
Risks: Video streaming is still too slow. We may want to change to a better processor like RPi 4. Changes: Switching to single item classification because new database is too large to manually label. Progress: YOLOv8 model training started. Recipes page app UI completed. Researched …
Risks: Video streaming is too slow. Switching to using a python library, hopefully the RPi Zero’s can handle it. Found online image dataset of produce that isn’t labeled for detection, just classification. Considering if switching to classification may be better for finishing on time. Changes: …
Risks: KV260s have yet to arrive to ECE inventory. We’ll be using an old laptop in the meantime, but it means development time won’t be spent into the KV260s until later. Changes: From a usability standpoint, we’ve decided to track whether an item is entering …
Risks: RPi Camera borrowed from the inventory was the HQ variant (which requires additional lens). Will need to buy new RPi Cameras. Michael has a family medical emergency and will be heading home on Wednesday evening. He’ll be able to work remotely on Thursday, and …
Risks: Meta Llama 2 LLM has some trouble giving a variety of recipes and at first tried to use as many ingredients as possible. We will test more specific prompts to see if it will work as intended. Another approach can be to try to …
Risks: Glare may be an issue when scanning smart labels. Software based to reduce glare have been shown to be computationally expensive. Consider adding a polarized film over the lens to cut out the glare. Premade produce recognition solutions may not be trained for off-angled …