{"id":197,"date":"2024-04-06T09:13:42","date_gmt":"2024-04-06T09:13:42","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/?p=197"},"modified":"2024-04-06T16:54:21","modified_gmt":"2024-04-06T16:54:21","slug":"sumayyas-status-report-for-4-06","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/2024\/04\/06\/sumayyas-status-report-for-4-06\/","title":{"rendered":"Sumayya&#8217;s Status Report for 4\/06"},"content":{"rendered":"<p><strong>Progress Update:<\/strong><\/p>\n<p><span style=\"text-decoration: underline\">From Last Week:<\/span><\/p>\n<ul>\n<li>Set up camera with system &#8211;\u00a0<strong>done<\/strong><\/li>\n<li>Test buttons and hand tracking with livestream video &#8211;\u00a0<strong>done<\/strong><\/li>\n<li>Test reID with livestream video &#8211;\u00a0<strong>done<\/strong><\/li>\n<li>integrate object tracking with camera \/ livestream &#8211;\u00a0<strong>not done<\/strong>\n<ul>\n<li>Re-define how much to track and what user will see<\/li>\n<\/ul>\n<\/li>\n<li>Start processing the recipe &#8211;\u00a0<strong>not done<\/strong><\/li>\n<\/ul>\n<p>I was able to demo gesture tracking mapped to button or gesture actions during the demo interim. This included setting up the external camera and testing gesture recognition\/tracking with the project screen. There was a large learning curve when I realized how to use Meta&#8217;s API functions for a livestream but I was able to run my code with a live video feed.<\/p>\n<p>Something I noticed was that there was a lot of latency in recognizing the gestures. I need to see if this was because of distance, \u00a0image quality or too much processing happening at once.<\/p>\n<p>I had also implemented part of the calibration script that will look at the projected image and determine each button&#8217;s region and each swipe region. This was tested with a video input and worked very well. It&#8217;s harder with a projection due to lighting and distance.<\/p>\n<p>Schedule:<\/p>\n<p><strong>Slightly behind:\u00a0<\/strong>Need to make more progress on object tracking since reID is complete.<\/p>\n<p><strong>Next Week Plans:\u00a0<\/strong><\/p>\n<ul>\n<li>improve accuracy and latebcy of detecting a hand gesture<\/li>\n<li>add object tracking with live video<\/li>\n<li>set up arducam camera with AGX (Were using Etron camera but it has too much of fish eye effect and the fps is not compatible with our projector)<\/li>\n<li>Help with recipe processing<\/li>\n<\/ul>\n<p><strong>Verification Plans:<\/strong><\/p>\n<p><strong><span style=\"text-decoration: underline\">Gesture Accuracy<\/span><\/strong><\/p>\n<ul>\n<li>Description: for each gesture, attempt to execute it on the specified region and note if system recognizes correctly<\/li>\n<li>Gestures:\n<ul>\n<li>Start Button<\/li>\n<li>Stop Button<\/li>\n<li>Replay Button<\/li>\n<li>Prev Swipe<\/li>\n<li>Next Swipe<\/li>\n<\/ul>\n<\/li>\n<li>Goal: 90% accuracy<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><strong><span style=\"text-decoration: underline\">Gesture Recognition Latency<\/span><\/strong><\/p>\n<ul>\n<li>Description: for each gesture, attempt to execute it on the specified region and measure how how long the system takes to recognize the gesture<\/li>\n<li>Goal: 3 seconds<\/li>\n<\/ul>\n<p><span style=\"text-decoration: underline\"><strong>Gesture Execution Latency<\/strong><\/span><\/p>\n<ul>\n<li>Description: for each gesture, attempt to execute it on the specified region and measure how how long the system takes to execute the gesture once its been recognized<\/li>\n<li>Goal: 1 second<\/li>\n<\/ul>\n<p><span style=\"text-decoration: underline\"><strong>Single Object Re-ID Detection Accuracy<\/strong><\/span><\/p>\n<ul>\n<li>Description: how accurately is a single object detected in a frame. An image of the object will first be taken. The system must be able to detect this object again using the reference image.<\/li>\n<li>Goal: 90% accuracy<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><span style=\"text-decoration: underline\"><strong>Single Object Tracking Accuracy\u00a0<\/strong><\/span><\/p>\n<ul>\n<li>Description: single object can be smoothly tracked across the screen<\/li>\n<li>Goal: given a set of continuous frames, object should be able to be tracked for 80-90% of the frames.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><span style=\"text-decoration: underline\"><strong>Multi Object Tracking Accuracy\u00a0<\/strong><\/span><\/p>\n<ul>\n<li>Description: multiple objects can be smoothly tracked across the screen<\/li>\n<li>Goal: given a set of continuous frames, all intended objects should be able to be tracked for 80-90% of the frames.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Progress Update: From Last Week: Set up camera with system &#8211;\u00a0done Test buttons and hand tracking with livestream video &#8211;\u00a0done Test reID with livestream video &#8211;\u00a0done integrate object tracking with camera \/ livestream &#8211;\u00a0not done Re-define how much to track and what user will see Start processing the recipe &#8211;\u00a0not done I was able to &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/2024\/04\/06\/sumayyas-status-report-for-4-06\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Sumayya&#8217;s Status Report for 4\/06&#8221;<\/span><\/a><\/p>\n","protected":false},"author":882,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts\/197"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/users\/882"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/comments?post=197"}],"version-history":[{"count":3,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts\/197\/revisions"}],"predecessor-version":[{"id":207,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts\/197\/revisions\/207"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/media?parent=197"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/categories?post=197"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/tags?post=197"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}