This week, I worked on testing the camera following Nvidia’s guide linked here https://developer.nvidia.com/embedded/learn/tutorials/first-picture-csi-usb-camera. We are now able to capture image data. I also worked on completing the integration of our primary computer vision application onto the Xavier board. There was an issue with compatibility with one of the libraries we are using so I am rewriting some of the code that handles loading the pre trained keras model. In addition I read through a research article describing how pose estimation can be done using landmarks linked here: https://www.cs.cmu.edu/~deva/papers/face/face-cvpr12.pdf. Progress is on schedule and my plan is to create a test suite and get baseline measurements for our MVP by next week.
Adriana’s Status Report for 03/13
This week I worked on the design review presentation along with the design review paper. That is where the majority of my time went towards along with working on testing out the face detection algorithm locally in which we will be migrating to our board at the start of next week. Now that we have the majority of our parts we can begin assembling it together. This will be our first big task in seeing how to different components of our project get to work together. So far, I am on schedule and I’m making good progress.
Jananni’s Status Report for 3/13
This week I focused on finalizing the block diagrams and research Adriana needed in order to present the Design Review Presentation. I also started working on the Design Report due next week. As a group we worked on the report and began putting the device together to start preliminary testing. We are a little behind on our schedule but next week we plan to ramp up because we have more time. I plan on completing a rough draft for the Design Report by Monday so that next week we can turn in the Final report and begin serious testing. I will also start working on the calibration procedure.
Team Status Report 03/13
The most significant risks that could jeopardize the success of the project right now is whether of not the program will run at a desirable frame rate on our board. This risk is mitigated by our contingency plan to use AWS for faster compute. There have been no major changes to our design this week. Our hardware components have been tested to ensure functionality and we are excited to see how our board will handle our preliminary implementation of the CV application.
Evann’s Status Report for 03/13
This week I spent the majority of my time working on the Design Review presentation/paper. I reviewed the presentations of my peers as well as worked on writing the design paper. I was able to set up the hardware and test the core I/O and ensured that everything was functional. My progress is on schedule and I hope to have a preliminary version of our program running on the board by next week.
Team’s Status Report for 03/06
As a team we all worked on our design review presentation. We had the chance to flush out all our block diagrams for the hardware and software components of our project. We decided on utilizing AWS compute power in case the board blows up or is not enough for our project. This also allowed us to obtain a better breakdown of our project and how all of our components are going to interact with one another. We are currently following our original schedule that we have planned out. Now that we have our Xavier board we can begin making some exciting progress by writing our preliminary code onto it.
Jananni’s Status Report for 3/6
This week we focused on ordering our most essential parts and finalizing our design. First, we put in orders for the Jetson Xavier and the Kit since those are essential. When we placed the order, we realized our TA wanted an official Budget so I created that.
Once the budget was finalized and our orders were approved, I started working on the PowerPoint for the design review presentation. I primarily worked on the metrics slides for the driver and the device. I used the comments and feedback I received from my Proposal Presentation and tried to incorporate that. After, I helped work on the block diagrams. Specifically, I worked on the System Specification: Hardware and System Specification: Software diagrams.
After, our parts arrived and we started assembling the device.
We are currently on track with our schedule. Next week we plan to start testing the software we have on the device and hopefully begin some optimization.
Adriana’s Status Report for 03/06
This week, I was able to further look into how we are going to be implementing our software component of our project. Specifically, the face detection / eye tracking algorithm using openCV and DNN. I was able to get install the necessary modules and have some of the openCV’s eye detection algorithms work on my local computer. I also worked on the design review presentation in which I will be delivering next week. The progress I have made is on schedule. Additionally, we ordered and received our parts for the project. This means that we can begin integrating the software module that we will need into our board and start our preliminary code writing next week. For next week, we hope to have tested and written some code on our board in order to have learned how to use it.
Evann’s Status Report for 3/6
This week, I worked on setting up a development environment for developing for the Jetson Xavier NX board. Our team has decided to move forward with Ubuntu as our OS as the Jetson Xavier has Ubuntu based software packages optimized specifically for the board that we want to use. Additionally, I worked with the rest of my team to create a Design Review slide deck. I used google doc’s drawing feature to create simple, straightforward block diagrams of the hardware system and the calibration process. Finally, I received some of the hardware that we requested and have been exploring how to set everything up.
Team Status Report for 2/27
This week, we presented our CarMa project proposal. We obtain informative feedback about issues we might face in the future. As a team, we also reviewed the presentations of all the other teams in our section. We met as a group this week and ordered the essential hardware components for our project. We also began further research into our chosen computer vision algorithms.