Weeelp, we’re finally nearing the finish line not only of this project but of our undergraduate careers. COVID-19 certainly didn’t make it easy for us, but we mustered through. It would’ve been great to have the opportunity to come together to integrate everything and see a fully finished project, but Read more…
Demo 2 Feedback and Wrapping Up! This week, we had a pretty successful second demo. Diego and Ike focused heavily on the software integration and showed the perception pipeline working in tandem with the rest of the CSM. One thing that they hadn’t considered was the time that the CSM Read more…
Demo Feedback and Speeding up the Perception Pipeline After a successful demo 2 in which Ike and I showed off the merged perception and CSM functionalities, I focused on speeding up the perception pipeline in an effort to get closer to our real-time tracking goal and have motor movement decisions Read more…
Integrating Perception Pipeline into the CSM This week, after a successful first demo showing object tracking and object detection working independently, Ike and I started talking about integrating InFrame’s software together. Mainly, this work involved getting a basic understanding of how the CSM calls the Perception pipeline and verifying that Read more…
Demo 1 and Multi-threading Frame Reads This week, for our first demo, I showed object detection working on live camera feed at a rate of about 10 FPS and object tracking working on a pre-recorded video of me skateboarding which ran at about 15 FPS. These FPS numbers are concerning, Read more…
Preparing for Demo 1 This week, the team mainly focused on finalizing a big portion of each individual subcomponent in order to demo it the following week. Ike is in the process of finishing a first draft of the CSM, in which different subcomponents are running concurrently and are simulating Read more…
Tracking Objects! This week, I mainly focused on finalizing the perception pipeline. This work involved installing the OpenCV contrib library on the Nano (surprisingly complicated actually) and making use of OpenCV’s various object tracking implementations to evaluate their performance on the Jetson Nano. Of all the different tracking methods that Read more…
Object Detection and OOP in Python This week, I started working on an outline of the perception pipeline and I implemented a first version of object detection. The Jetson Nano image includes the NVIDIA Jetpack SDK which makes developing and deploying AI solutions a breeze. All I really had to Read more…
Perception Pipeline, Virus Edition This week, given the COVID-19 outbreak, the team discussed the refocussing decisions needed to be made in order to complete the project by working remotely. I mainly redesigned the perception pipeline to accomodate for the fact that it will likely be implemented and tested with a Read more…
Last week, the team finalized InFrame’s design! Check it out under our Documents tab. Going over each aspect of our design really forced us to find holes and pinpoint weaknesses in our implementation strategy. By having to justify each design decision, we were able to drive our design further and are Read more…