Carnegie Mellon ECE Capstone, Spring 2024 | Kelly Cha, Michael Crotty, Sebastian Peralta
Risks: Camera feed real time streaming directly on the Flutter app might not work. Possible options: Use a streaming platform that is made to display live videos on Flutter Get a raspberry pi video screen to display the video from the scanners and mount to …
Weekly Accomplishments Debugged issue where both the ribbon cable & raspberry pi CSI port were broken. Likely caused from transport (static electricity?) Completed scanner Assembled full scanner unit Printed case v2 (allows for cable to be inserted) Soldered I2C pins to control LCD Assembled everything …
Weekly Accomplishments Trained YOLOv8 model which ran on my old laptop for almost a full week. Training results show 99% accuracy which is a tad worrysome with overfitting, but we’ll cross that bridge when we get there. Booted Kria KV260, updated packages, and launched server …
Risks: Video streaming is still too slow. We may want to change to a better processor like RPi 4. Changes: Switching to single item classification because new database is too large to manually label. Progress: YOLOv8 model training started. Recipes page app UI completed. Researched …
Weekly Accomplishments Ethics Assignment Manual Data Gathering + Labeling. Spent probably 8+ hours grabbing images from online of our produce items and manually labeling them. However, a higher quantity of images (under different lighting, background, etc) is probably more helpful than the images I was …
Risks: KV260s have yet to arrive to ECE inventory. We’ll be using an old laptop in the meantime, but it means development time won’t be spent into the KV260s until later. Changes: From a usability standpoint, we’ve decided to track whether an item is entering …
Due to a family medical emergency, I wan’t able to do much besides work on the design report this past week. We completed the design report and I worked on many of the diagrams, updated our CAD models, as well as wrote much of the content for the Design Requirements, Architecture, Implementation and Related Work sections.
I’m not behind, but I’ve got a lot of work to do in the coming weeks. Thankfully, we had enough notice that I would be leaving early that we could slightly rework our schedule. However, it meant that I wasn’t able to confirm the new camera hardware works as expected.
The biggest concern towards progress is we have yet to recieve notice that the AMD hardware has arrived to the ECE inventory. We’ll be using an old laptop that I have in place of our planned KV260, but ideally we get everything working on the KV260 sooner rather than later.
Weekly Accomplishments Practiced & Presented Design Review Presentation Setup preliminary socket code for communicaiton on a local network The above screenshot demonstrates two computers communicating on the same local network. Using a python library called pickle, python objects can be serialized into bytes. Here, I’m sending …