Summary
- Continued working on ML model performance improvement
- Fully integrating sqlite database code into webserver
- Worked on the frontend code and finished the login and register page
What are the most significant risks that could jeopardize the success of the project? How are these risks being managed? What contingency plans are ready?
1. Current Setup (inference in worker threads within the web server): Quick to implement, manageable for small model sizes, and tolerable failure cases. Offers greater scalability and flexibility, with the potential for GPU support on separate machines, but requires more development effort. Sticking with the current setup, as its advantages align better with our non-cloud focus at this time.
2. Experimented with alternative inference backends, including PyTorch and Onnxruntime, but concluded they don’t yield significant performance gains.
3. Tested latency and throughput for each backend, discovering that. Increased workers don’t linearly improve latency due to resource contention. Throughput does improve slightly, but optimal performance is reached with 1-2 workers depending on the backend.
4. Began implementing JWT-based authentication, which provides better control over user access without relying on Flask-Login. Basic login functionality is set up, and images are secure to each user’s account.
5. Updated the design and UI features for the front end and created more end-points to connect more backend functions to the frontend
Were any changes made to the existing design of the system (requirements, block diagram, system spec, etc)? Why was this change necessary, what costs does the change incur, and how will these costs be mitigated going forward?
Progress is mostly on track, we adjusted for a team member’s unavailability last week and have almost caught up.
Provide an updated schedule if changes have occurred.
No significant changes in the schedule. We used the built-in slack time to compensate for the unavailability and so we are still on track.
This is also the place to put some photos of your progress or to brag about a
component you got working.
Updated UI for login page. Will add pictures for other pages in the next update.
0 Comments