{"id":38,"date":"2025-02-09T04:08:40","date_gmt":"2025-02-09T04:08:40","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/?p=38"},"modified":"2025-02-09T04:20:55","modified_gmt":"2025-02-09T04:20:55","slug":"team-status-report-for-february-8-2025","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/2025\/02\/09\/team-status-report-for-february-8-2025\/","title":{"rendered":"Team Status Report for February 8, 2025"},"content":{"rendered":"<p><b>Project Risks and Mitigation Strategies\u00a0<\/b><\/p>\n<ul>\n<li>Gesture Recognition Accuracy and Performance Issues\n<ul>\n<li>Risk: the accuracy of the gesture detection might be inconsistent or there might be limitations in the model chosen<\/li>\n<li>Mitigation: test multiple approaches (MediaPipe, CNNs, Optical Flow) to determine the most robust method and then fine tune the model<\/li>\n<li>If vision recognition is very unreliable, explore other sensor based alternatives such as integrating IMUs for gesture detection<\/li>\n<\/ul>\n<\/li>\n<li>Microcontroller compatibility\n<ul>\n<li>Risk: the microcontroller needs to support the real time data processing for the gesture recognition and AR display without latency issues<\/li>\n<li>Mitigation: carefully evaluate microcontroller options to ensure compatibility with CV model. The intended camera board is designed for intensive visual processing.\n<ul>\n<li>If the microcontroller is not suitable for the CV model, we will look into offloading some of the processing power from the microcontroller to the laptop. This may require sending a great deal of data wirelessly and must be approached with caution.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><b>Changes to the System Design\u00a0<\/b><\/p>\n<ul>\n<li>Finalizing the device selection: There are fewer development board options than modules; however, we need the development board as we do not have the time to sink into creating our own environment. So we will be using the <a href=\"https:\/\/www.amazon.com\/Espressif-ESP32-DevKitC-32E-Development-Board\/dp\/B087TNPQCV\">ESP32-DevKitC-VE<\/a> Development Board, which implements a WROVER-E controller. This has the most storage capacity for its form factor and reasonable price.\n<ul>\n<li>See <a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/2025\/02\/09\/rebeccas-status-report-for-february-8-2025\/\">Rebecca&#8217;s status report<\/a> for the same week for more information about the device selection.<\/li>\n<\/ul>\n<\/li>\n<li>Refining the computer vision model approach: Initially only considered a CNN based classification model for gesture recognition but after more research also testing MediaPipe and Optical Flow for potential improvements<\/li>\n<\/ul>\n<p><b>Schedule Progress<\/b><\/p>\n<p>Our deadlines do not start until next week, so our schedule remains the same.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Project Risks and Mitigation Strategies\u00a0 Gesture Recognition Accuracy and Performance Issues Risk: the accuracy of the gesture detection might be inconsistent or there might be limitations in the model chosen Mitigation: test multiple approaches (MediaPipe, CNNs, Optical Flow) to determine the most robust method and then fine tune the model If vision recognition is very &hellip; <a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/2025\/02\/09\/team-status-report-for-february-8-2025\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Team Status Report for February 8, 2025<\/span><\/a><\/p>\n","protected":false},"author":1074,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1,7],"tags":[3],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/wp-json\/wp\/v2\/posts\/38"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/wp-json\/wp\/v2\/users\/1074"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/wp-json\/wp\/v2\/comments?post=38"}],"version-history":[{"count":1,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/wp-json\/wp\/v2\/posts\/38\/revisions"}],"predecessor-version":[{"id":39,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/wp-json\/wp\/v2\/posts\/38\/revisions\/39"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/wp-json\/wp\/v2\/media?parent=38"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/wp-json\/wp\/v2\/categories?post=38"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb1\/wp-json\/wp\/v2\/tags?post=38"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}