{"id":136,"date":"2024-03-09T18:11:23","date_gmt":"2024-03-09T18:11:23","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/?p=136"},"modified":"2024-03-10T04:38:59","modified_gmt":"2024-03-10T04:38:59","slug":"sumayyas-status-report-3-9","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/2024\/03\/09\/sumayyas-status-report-3-9\/","title":{"rendered":"Sumayya&#8217;s Status Report &#8211; 3\/9"},"content":{"rendered":"<p><strong>Progress Update:<\/strong><\/p>\n<p>I completed the Swipe Gesture Recognition as planned last report. I would need to test in a kitchen environment with our UI to further improve the gesture. This will be done once our UI is programmed.<\/p>\n<p>I researched algorithms for object tracking along with some suggestions from Prof. Marios. I will be using the SIFT algorithm to track objects using their features. Since the object will be in a known location in the &#8220;first frame&#8221;, we will have an easy reference image to start tracking. In my research, I found a video by Shree K. Nayar explaining how feature tracking works. I plan to use this as a basis for my implementation.<\/p>\n<p><iframe loading=\"lazy\" width=\"525\" height=\"295\" src=\"https:\/\/www.youtube.com\/embed\/vbGRUU_Xj1A?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen title=\"Tracking by Feature Detection | Object Tracking\"><\/iframe><\/p>\n<p>Before attempting Nayar&#8217;s implementation, I attempted some tracker libraries that already exist in opencv. Specifically, I tried the KCF (Kernalized Correlation Filter) to track a couple objects. I followed the <a href=\"https:\/\/medium.com\/@khwabkalra1\/object-tracking-2fe4127e58bf\">example<\/a> by Khwab Kalra. I found that the KCF algorithm works great for easily identifiable and slow moving objects such as a car on a road. But it struggled to track a mouse moving across a screen. I&#8217;m not sure why this is the case yet and have much more testing to do with various example videos. OpenCV has 8 different trackers all with different specializations. I will test each of these trackers next week to see which works best. If they are not robust enough, I plan to use Nayar&#8217;s implemention with SIFT.<\/p>\n<p><strong>Link to Car tracking using KCF:<\/strong>\u00a0<a href=\"https:\/\/drive.google.com\/file\/d\/1zUjeYSGWuIXzmaCbMIEO1zvzxUYZY6Lv\/view?usp=sharing\">https:\/\/drive.google.com\/file\/d\/1zUjeYSGWuIXzmaCbMIEO1zvzxUYZY6Lv\/view?usp=sharing<\/a><\/p>\n<p><strong>Link to Mouse tracking using KCF:<\/strong><\/p>\n<p><a href=\"https:\/\/drive.google.com\/file\/d\/1zUjeYSGWuIXzmaCbMIEO1zvzxUYZY6Lv\/view?usp=sharing\">https:\/\/drive.google.com\/file\/d\/1zUjeYSGWuIXzmaCbMIEO1zvzxUYZY6Lv\/view?usp=sharing<\/a><\/p>\n<p>As for the AGX, I have received confirmation from Prof. Marios&#8217;s grad students that it has been flashed and ready to be used.<\/p>\n<p><strong>Schedule Status:<\/strong><\/p>\n<p>On track!<\/p>\n<p><strong>Next Week Plans:<\/strong><\/p>\n<ul>\n<li>Implement and improve the 8 OpenCV trackers by next weekend. Select the tracker that works best for this project.<\/li>\n<li>Implement SIFT for object tracking if OpenCV trackers are not good<\/li>\n<li>If above step is complete, run algorithm on a real time video stream.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Progress Update: I completed the Swipe Gesture Recognition as planned last report. I would need to test in a kitchen environment with our UI to further improve the gesture. This will be done once our UI is programmed. I researched algorithms for object tracking along with some suggestions from Prof. Marios. I will be using &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/2024\/03\/09\/sumayyas-status-report-3-9\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Sumayya&#8217;s Status Report &#8211; 3\/9&#8221;<\/span><\/a><\/p>\n","protected":false},"author":882,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts\/136"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/users\/882"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/comments?post=136"}],"version-history":[{"count":3,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts\/136\/revisions"}],"predecessor-version":[{"id":151,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts\/136\/revisions\/151"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/media?parent=136"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/categories?post=136"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/tags?post=136"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}