What did you personally accomplish this week on the project?
This week, I primarily worked on setting up a separate inference server for GroundingDINO. This server would allow the Raspberry Pi, which normally does not have access to performant hardware, to run a modern, modern, high-accuracy model. The vast majority of the complaints made during our interim demo were regarding how the ML model sometimes reported inaccurate data, such as false positives where it hallucinated seeing an object, or a missed detection in other cases. As such, I made it a priority to improve the performance of the model as quickly and effectively as I could. Given our group had already invested significant resources into investigating the feasibility of GroundingDino, and had found plausible use for it, it made sense to integrate the model into our pipeline. I additionally made sure to implement the change in such a way that it was clean and extensible. Changing the “inference model” to GroundingDino only requires changing a single string in the configs file.
Enacting the change required coding up an entirely new webserver, understanding the demo code well enough to be able to run an inference successfully and draw the appropriate bounding boxes manually (which itself was easier said than done), configuring the machine that the GroundingDINO server was running on in a way that would allow the server to communicate with the outside world, and performing the necessary webserver changes to allow the webserver to communicate with the GroundingDINO server.
Additionally, my teammates have begun to need to modify the internals of the webserver to support features that they wish to implement, notably the voice querying pipeline, and some new database functionality. This has required me to spend a significant amount of time explaining how to setup and modify various aspects of the webserver, and giving in-depth explanations on how exactly the server runtime operates, and why implementing features a certain way may be infeasible/unadvisable.
Is your progress on schedule or behind? If you are behind, what actions will be
taken to catch up to the project schedule?
I believe my progress is still on-schedule. I still have some work to do, as I will discuss below, but I believe it can be completed by the final presentation/report deadlines.
What deliverables do you hope to complete in the next week?
At this point, my primary objective will be to contribute the necessary information towards creating a good presentation, report, and final demo. This may require running some additional tests, and some additional integration, but I think most of my implementation work has been done at this point.
0 Comments