{"id":91,"date":"2020-03-07T09:46:48","date_gmt":"2020-03-07T14:46:48","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/?p=91"},"modified":"2020-03-07T12:17:04","modified_gmt":"2020-03-07T17:17:04","slug":"team-status-report-for-03-07","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/2020\/03\/07\/team-status-report-for-03-07\/","title":{"rendered":"Team Status Report for 03\/07"},"content":{"rendered":"<p><span style=\"font-weight: 400\">This week, we started going deeper into the machine learning aspect of things. After some experimentation with OpenPose on the Nano, it became abundantly clear that if we want to meet our speed requirements we definitely should not run it locally. It\u2019s good to know this early on &#8211; now we know that AWS EC2 is definitely the only way forward if we want to keep our current design of utilizing both OpenPose and OpenCV.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">We also found out that OpenPose doesn\u2019t recognize the back of hands, especially gestures where the fingers are not visible (like a closed fist with the back of the hand facing the camera). We are going to re-map some of our gestures so that we know that each gesture is, at minimum, recognized by OpenPose. This would greatly reduce the risk of a gesture that is never recognized later on, or the need for additional machine learning algorithms incorporated into the existing infrastructure.\u00a0<\/span><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-medium wp-image-94\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/back-fist_rendered-300x200.png\" alt=\"\" width=\"300\" height=\"200\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/back-fist_rendered-300x200.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/back-fist_rendered-768x512.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/back-fist_rendered-1024x683.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/back-fist_rendered.png 1080w\" sizes=\"(max-width: 300px) 85vw, 300px\" \/> <img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-medium wp-image-95\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/back_rendered-300x200.png\" alt=\"\" width=\"300\" height=\"200\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/back_rendered-300x200.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/back_rendered-768x512.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/back_rendered-1024x683.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/back_rendered.png 1080w\" sizes=\"(max-width: 300px) 85vw, 300px\" \/> <img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-medium wp-image-96\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/fist1_rendered-300x200.png\" alt=\"\" width=\"300\" height=\"200\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/fist1_rendered-300x200.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/fist1_rendered-768x512.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/fist1_rendered-1024x683.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/fist1_rendered.png 1080w\" sizes=\"(max-width: 300px) 85vw, 300px\" \/> <img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-medium wp-image-97\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/sung1_rendered-300x200.png\" alt=\"\" width=\"300\" height=\"200\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/sung1_rendered-300x200.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/sung1_rendered-768x512.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/sung1_rendered-1024x683.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-content\/uploads\/sites\/100\/2020\/03\/sung1_rendered.png 1080w\" sizes=\"(max-width: 300px) 85vw, 300px\" \/><\/p>\n<p>(OpenPose can detect the hand backwards, but cannot do the same with a fist backwards)<\/p>\n<p><span style=\"font-weight: 400\">We are quickly realizing the limitations of the Nano and seriously reconsidering changing to the Xavier. We are in contact with our advisor about this situation, and he is ready to order an Xavier for us if need be. Within the next two weeks, we can probably make a firmer decision on how to proceed. So far, only the CPU has shown serious limitations (overheating while running basic install commands, running OpenPose, etc.). Once OpenCV is installed and running, we can make a more accurate judgement. <\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This week, we started going deeper into the machine learning aspect of things. After some experimentation with OpenPose on the Nano, it became abundantly clear that if we want to meet our speed requirements we definitely should not run it locally. It\u2019s good to know this early on &#8211; now we know that AWS EC2 &hellip; <a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/2020\/03\/07\/team-status-report-for-03-07\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Team Status Report for 03\/07&#8221;<\/span><\/a><\/p>\n","protected":false},"author":301,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[2,6],"tags":[5],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-json\/wp\/v2\/posts\/91"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-json\/wp\/v2\/users\/301"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-json\/wp\/v2\/comments?post=91"}],"version-history":[{"count":3,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-json\/wp\/v2\/posts\/91\/revisions"}],"predecessor-version":[{"id":99,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-json\/wp\/v2\/posts\/91\/revisions\/99"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-json\/wp\/v2\/media?parent=91"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-json\/wp\/v2\/categories?post=91"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s20-teamf0\/wp-json\/wp\/v2\/tags?post=91"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}