We’re working on integration and trying to get everything running smoothly on the pi. We’ve run many individual tests and so far we’re meeting our specification requirements. We had 90% accuracy for the model on the test image dataset. Our battery life was between 4-5 hours. The device weighs under 1kg. Currently we’re able to run at about 10FPS which meets our 2s latency spec, however, we have some more integration to do and hope that we can continue to meet the specification.
Krrish’s Status Report 04/26/25
I’m working on integration and optimising the script to run locally on the pi. We’re running into some issues as ocr is very computationally heavy. I’m testing various techniques like threading, running it on intervals, etc. I also tested the depth accuracy for the camera system.
Krrish’s Status Report 04/19/2025
I’ve been working on the AI accelerator and trying to compile our custom models to run on it. I’ve gotten the software and drivers installed but am struggling with the optimisation and compiling steps involved. I’ve also been working on integration of the model and the raspberry pi.
One thing i’ve learnt is that we need constant communication and we need to start integrating early. Learning to communicate and give feedback in a team is important to keep everyone on track. It also ensures everyone is constantly working on integration so it’s not left to the end.
Krrish’s Status Report 04/12
I assembled the cameras and raspberry pi into it’s 3d printed housing. I have stereo depth working and am now integrating with the YOLO model. I’m having trouble getting the model to compile so it can run on the accelerator. I need to install a lot of drivers on an x86 machine which is proving difficult as I don’t have one and need to go to campus. The software is also prone to a lot of issues which I am in the process of figuring out
Krrish’s Status Report 3/29
I’m running experiments with the camera and YOLO model. It is struggling and working quite slowly with significant delays. I’ve put together a list of new camera options and have narrowed it down to pretty much 2 options. I will place an order on the one i think will work best.
Team Status Report 3/29
We have OCR and the YOLO model working independently. We are working on integrating that and also testing on videos rather than still frames. Our goal is to have this working on our laptops and then integrate it with the Pi. Simultaneously we are testing the camera on the Pi with the YOLO model to see how fast it would run. Currently it looks like the camera is running too slow on the pi and so we’re looking at different options. We’ve narrowed it down to 3 options and will place an order today.
Krrish’s Status Report 3/22
I’m doing research into new camera that we can use since the old camera is not compatible with the AI accelerator. I’ve also made progress on the CAD model.
Krrish’s Status Report 3/15
I finally for the camera working on the raspberry pi, however, it doesn’t seem very stable. The AI hat might also not be compatible with it and the depth sensing is not great. I’ve been looking at alternatives like the raspberry pi camera and the intel realsense camera. I will have to rework the CAD files according to the new camera.
Krrish’s Status Report 3/8
I continued the integration of the camera. I’m awaiting the delivery of the AI hat and have setup the necessary libraries to integrate and test it.
Team Status Report 02/22
We have decided on the form factor of the device: waist mounted camera system. We have started training the ML model, the CAD of the physical product and UI components. Everyone is working individually right now with a plan to integrate soon.