{"id":117,"date":"2024-02-24T16:17:53","date_gmt":"2024-02-24T16:17:53","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/?p=117"},"modified":"2024-02-24T16:49:15","modified_gmt":"2024-02-24T16:49:15","slug":"sumayyas-status-report-for-2-24","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/2024\/02\/24\/sumayyas-status-report-for-2-24\/","title":{"rendered":"Sumayya&#8217;s Status Report for 2\/24"},"content":{"rendered":"<p><strong>Progress Update:<\/strong><\/p>\n<p>This week I made progress on gesture recognition using MediaPipe. I had already tested MediaPipe using the web browser demo, but this past week I worked on writing a python script to make the Gesture Recognition model work with my laptop camera. The script was able to recognize all the gestures that MediaPipe was originally trained for.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/drive.google.com\/file\/d\/1Xvm71s50BpO0O9d-hPm9-XWkQNBlrgQR\/view?usp=share_link\">https:\/\/drive.google.com\/file\/d\/1Xvm71s50BpO0O9d-hPm9-XWkQNBlrgQR\/view?usp=share_link<\/a><\/p>\n<p>Above is the link to a video demonstrating MediaPipe on my laptop. Angle of gesture is very important (notice how thumbs down was hard to recognize due to poor wrist position\/angle).<\/p>\n<p>The following are the gestures we decided we will need through out the program:<\/p>\n<ul>\n<li>Open Palm (right hand)<\/li>\n<li>Open Palm (left hand)<\/li>\n<li>Swipe (left to right)<\/li>\n<li>Swipe (right to left)<\/li>\n<\/ul>\n<p>The first two gestures are already trained for in the model. For the Swipe gestures, I learned how to access the 21 hand landmarks and their properties such as the x, y, and z coordinates. This had originally proved to be difficult because the documentation was not easily accessible. Since a swipe is a translation on the x axis, I plan to simply calculate the difference in the x-coordinate over a set of frames to determine a Swipe.<\/p>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_120\" aria-describedby=\"caption-attachment-120\" style=\"width: 546px\" class=\"wp-caption alignnone\"><img decoding=\"async\" loading=\"lazy\" class=\"wp-image-120\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-content\/uploads\/sites\/310\/2024\/02\/Screenshot-2024-02-24-at-11.42.01\u202fAM-300x185.png\" alt=\"\" width=\"546\" height=\"337\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-content\/uploads\/sites\/310\/2024\/02\/Screenshot-2024-02-24-at-11.42.01\u202fAM-300x185.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-content\/uploads\/sites\/310\/2024\/02\/Screenshot-2024-02-24-at-11.42.01\u202fAM-768x474.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-content\/uploads\/sites\/310\/2024\/02\/Screenshot-2024-02-24-at-11.42.01\u202fAM-1024x632.png 1024w\" sizes=\"(max-width: 546px) 100vw, 546px\" \/><figcaption id=\"caption-attachment-120\" class=\"wp-caption-text\">On the left you can see the x, y, z coordinates of each of the 21 landmarks for each frame in the video.<\/figcaption><\/figure>\n<p><a href=\"https:\/\/drive.google.com\/file\/d\/15Q_YZcS0Vv8EEd6kOf7mQT8irsR37j3Y\/view?usp=share_link\">https:\/\/drive.google.com\/file\/d\/15Q_YZcS0Vv8EEd6kOf7mQT8irsR37j3Y\/view?usp=share_link<\/a><\/p>\n<p>Above video shows what the Swipe Gesture looks like from right to left.<\/p>\n<p><strong>Schedule Status:\u00a0<\/strong><\/p>\n<p>I am on track with my gesture recognition and tracking schedule. But I am behind with flashing the AGX as I still have not been able to get an external PC. There have been slow communications with Cylab. I plan to talk to the professor next week and find a quick solution. But I am not too concerned at the moment, as much of my testing with MediaPipe can be done on my laptop.<\/p>\n<p><strong>Next Week Plans:<\/strong><\/p>\n<ul>\n<li>Complete Swipe Gesture Recognition<\/li>\n<li>Research algorithms for object tracking<\/li>\n<li>Start implementing at least one algorithm for object tracking<\/li>\n<li>Get a PC for flashing AGX and flash the AGX<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Progress Update: This week I made progress on gesture recognition using MediaPipe. I had already tested MediaPipe using the web browser demo, but this past week I worked on writing a python script to make the Gesture Recognition model work with my laptop camera. The script was able to recognize all the gestures that MediaPipe &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/2024\/02\/24\/sumayyas-status-report-for-2-24\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Sumayya&#8217;s Status Report for 2\/24&#8221;<\/span><\/a><\/p>\n","protected":false},"author":882,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts\/117"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/users\/882"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/comments?post=117"}],"version-history":[{"count":3,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts\/117\/revisions"}],"predecessor-version":[{"id":121,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/posts\/117\/revisions\/121"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/media?parent=117"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/categories?post=117"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame8\/wp-json\/wp\/v2\/tags?post=117"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}