Accomplished
Jerry and I filmed the videos for all three use cases together. We planned the recordings to cover the main states and as many edge cases as we could. Our four squat-rack clips show an empty rack, someone exercising with belongings nearby, someone leaving those belongings, and someone returning to collect them.
I built the squat-rack workflow in two phases. During setup, models find the rack and propose areas for exercise, nearby attendance, and belongings beside or in front of it. I built a region editor so a gym staff member setting things up for the first time can adjust those areas or exclude a neighboring machine.
During detection, the system checks video twice per second for people and belongings. It reports whether the rack is available, in use, waiting after someone leaves items, or unknown because the evidence is insufficient. The five-minute review rule is implemented, but our recordings are too short to demonstrate a real alert.
On the four development clips, 54 of 63 scored rack-state observations were correct and nine were unknown. Belongings presence was correct in 52 of 64 observations, with 12 unknown. I compared two belongings models on my laptop. The default took a median of 376 milliseconds per check. A faster alternative took 92 milliseconds but missed more items. I also separated the models needed only during setup from those needed on every detection check. This helps us plan what may run at the same time on the Jetson, although these are laptop measurements rather than Jetson results. The accuracy results come from one camera view and labels prepared during development.
Progress
The squat-rack workflow runs on my laptop, and the team now has separate laptop workflows for all three use cases. The Jetson baseline planned for the week of September 28 is behind schedule. I have not run my workflow on the board or tested three feeds together. We will first agree on a shared output format and measure each workflow on the Jetson, then try them together before deciding whether scheduling changes are needed.
Deliverables
- Contribute the squat-rack implementation, results, and limitations to the October 9 design report.
- Record longer rack scenarios with bags, headphones, passersby, people behind the rack, and a full unattended period. Keep some footage for a separate evaluation and have a teammate review a sample of the labels.
- Work toward a three-feed Jetson test, measuring processing time and memory for each workflow before measuring them together.