As a team, we are attempting to work through two main tasks. The first is the integration of the web app and the ML model. As mentioned in individual reports, the web app can now receive data from a local source, so now we are trying to test this process in a real-time system. There are some small issues to consider, such as duplicate cards (which can happen with multiple decks), not double counting cards, etc. We hope to finalize this process by next week, but for now, we can start the second main task, which is testing the metrics. For the presentation, we hope to get most of these metrics done, but for some metrics, such as the user survey, we won’t have results immediately. We have finalized our methodology, and very soon, we will conduct these tests.
Lohith’s Status Report for Apr 19, 2025
I was able to address the changes mentioned in the last status report. I laser cut two long planks and glued them to the bottom of the box, with each of them protruding out in the same direction, so that if the camera were to stick out in that direction, the box would no longer tip over. Some of the planks fell apart, so I plan to hot glue them soon. Also, to further stabilize the camera mount, I laser cut a plank with a hole in it. The camera mounting hole almost perfectly sticks through it, so once I hot glue that to the top, the camera mount should exhibit very limited movement when the user moves the camera. On top of this, I have been working on the slides for the final presentation.
Joe’s Status Report for April 19th
This week I have managed to get almost all of the website applications functionalities up and running. I managed to get the web application to have a decent amount of functionality on phones and tablets. Additionally, it is fully capable of taking streaming updates from a local source. I’m hoping to fully secure it next week and complete integration as a whole next week
Personally, I did not have to deal with streaming updates to a web application in the past when it came to developing web applications. I think my experience this time allowed me to learn a lot when it came to this area. I had to research a lot of new things to properly implement features when it came to this area.
Nicholas’ Status Report for April 19th
This week was focused on finishing integration and optimizing the ML Model. I was able to integrate the ML model with the Jetson by retraining it on the ECE Clusters on a Python 3.8 environment, and I tested it with TensorRT and it functioned properly. However, something that we anticipated and encountered was how the Yolo11L model was a bit slow for inference, so we retrained for 2 epochs with the Yolo11S model. We will continue to optimize the logic and finish integration with the WebApp over the next week, as we are almost done with the vision model.
I was aware of ways to write CUDA kernels to speed up and optimize inference, but I was not aware of TensorRT for this optimization, which I was made aware of during the 2nd presentation. Overall, the most important skill I have learned throughout this project is how to rapidly prototype Vision Models. I learned how to do so via blog posts and reading other peoples experiences online, through NVIDIA forums and Stack overflow posts. This has greatly decreased the time I need to go from a base idea to a working Vision Model, which I feel has been a great thing to learn throughout Capstone.
Team Status Report for April 12th, 2025
We were able to run the ML model on the Jetson Nano at last. We initially thought that this would entail reflashing the microSD card, but it was actually possible with just a few Python installations to get to 3.11. Now, this leaves the final major integration step, which is the transmission of card detections from the ML model to the processing algorithm, which we are working on. We also would like to broadcast the camera feed to the web app so that the user can calibrate the camera. Once we finish these integration steps, we then will start testing the key parameters of our product to assess viability.
Lohith’s Status Report for April 12, 2025
Since the last status report and demo, a lot of work has been done on improving the apparatus that houses the Nano and the camera mount. This improved design is made of plywood and stuck together with hot glue. After piecing the structure together, I tested the integrity of the structure, and it seems to be good, except for the case where the camera significantly tilts over the edge, at which point the structure falls. The solution here, which I will implement shortly, is to glue the box to long flat planks that jut out forward. In this case, even if the camera leans forward, the box won’t fall forward.
Nicholas’ Status Report 12th April, 2025
The demo went well, but we ran into some issues with fixing the camera angle, so I have retrained the model on less epochs and started working on some testing, both with the current model and looking for possible alternate datasets, to try and improve the vision algorithms improvement in more difficult scenarios. Lohith also re-flashed the Jetson and now we can load a version of the model on it, so I will continue testing and working with the ML model and then I will move to Jetson tests throughout the week.
Joe’s Status Report 12th April, 2025
The demo went well and I got a lot of good feedback on the web application. One of the feedbacks was regarding the font size of the Game Settings page. I managed to change this page from having a single column to a double column. Additionally, I managed to add a help page describing how to play Blackjack and how to use the application properly, as per the suggestions that were given. However there are currently still some bugs with regards to streaming updates so I hope to resolve that and settle integration.
Team Status Report 29th March, 2025
This week we have been working on some final fixes for all of our individual components. Currently, most components are looking good and we are conversing to make sure that there is an alignment between our components for the purpose of integration. We have also been discussing on how we want the interim demonstration to go and how we will design it.
Joe’s Status Report 29th March, 2025
This week I have managed to get most of the web application to be running. I’ve added some pictures of some of the web pages below. Right now the processing algorithm is still struggling a little bit so I’m continuing to work on that, hopefully getting it done by the interim demonstration. I have yet to complete integration with the ML model but it seems like this part should not be too difficult.
