Michael’s Status Report for 4/6/2024

Weekly Accomplishments

• Prepared for Interm Demo
  • Spent another 4 hours trying to accelerate YOLO model on KV260 without success. YOLO demo was done on laptop.
  • Created dataset and trained new demo YOLOv8 model because the previous model had issues with actually classifying objects correctly.
  • Finally 3D printed the first case prototype for the Raspberry Pi. Some modifications are needed, but for the most part the case looks good.
  • Wrote code for LCD display. However, demo of LCD didn’t end up happening because we didn’t solder header pins to the Raspberry Pi for prototyping
• Switched from Kria KV260 to Nvidia Jetson Nano because hardware acceleratation on the KV260 had issues being setup.
  • Spent multiple hours installing packages because Jetson Nano image is based on Ubuntu 18.04 (which is no longer supported), so time was spent updating packages and compiling a newer version of Python.
  • Set up Jetson Nano to the spot the KV260 was at.
• Video of Demo:

Overall Progress

• We think interm demo was successful.
• Next week is the big grind to get everything finished up (likely on Tuesday).
• We want to start final presentation work after Carnival.

Next Week’s Goals

• Print next prototype of the Raspberry Pi case.
• Verify all the subsystems.
• Integrate scanners with the web app.
• Validate system works end to end
  • Test entering/removing objects from inventory by moving items in/out of view of the camera by logging whats happening
  • Test object detection causes the proper items to be displayed on LCD screen
  • Test entering/removing objects causes proper API calls to be done.
  • Validate objects from each category get detected properly.