{"id":119,"date":"2024-09-28T22:38:36","date_gmt":"2024-09-28T22:38:36","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/?p=119"},"modified":"2024-09-29T02:40:22","modified_gmt":"2024-09-29T02:40:22","slug":"shayes-status-report-for-9-28","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/2024\/09\/28\/shayes-status-report-for-9-28\/","title":{"rendered":"Shaye&#8217;s Status Report for 9\/28"},"content":{"rendered":"<p><span style=\"font-weight: 400\">I started this week by continuing to work on the hand tracking pipeline\u2014mostly adding in two-handed tracking abilities. My main focus of the week was working with pianists on Wednesday. The hand tracking ran smoothly with the pianists and we were able to record some footage (<\/span><a href=\"https:\/\/drive.google.com\/file\/d\/1kPLTQxwjPjrtIixGn6Iqr0qD-1UgO-Mm\/view?usp=drive_link\"><span style=\"font-weight: 400\">linked here<\/span><\/a><span style=\"font-weight: 400\">). I made a key discovery during the session\u2014<\/span><b>hand tension isn\u2019t determined by set deviation in either direction. Tension occurs when the wrist is held in one position for too long.<\/b><span style=\"font-weight: 400\"> So, I\u2019ll be changing the pipeline to look for changes in wrist angle instead of specifically looking for ulnar\/radial deviation. If the wrist remains at the same angle for too long, the pipeline will signal for a buzz.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">There are no new issues with the pipeline. I still need to integrate a way to tell which direction the wrist is deviated\u2014however, since we\u2019re now tracking wrist angle changes, this is more of a \u201cnice to have\u201d rather than a necessary component.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">Despite the change, I\u2019m still on schedule. For next week, I\u2019ll focus on continuing to beautify the code I have as well as looking into how to port Mediapipe to Pytorch. Jessie has started looking more into the KV260 and discovered that TFLite, the framework Mediapipe is based on, isn\u2019t supported by the system. We\u2019ll need to convert it to Pytorch or Tensorflow instead. I found more online resources <\/span><a href=\"https:\/\/github.com\/AlbertaBeef\/blaze_tutorial\/blob\/2023.1\/vitis-ai\/vitisai_pytorch_flow.py\"><span style=\"font-weight: 400\">outlining how to port to Pytorch<\/span><\/a><span style=\"font-weight: 400\"> so I\u2019ll start looking there first. Finally, we\u2019ll be putting in the order for our camera stand next week, so I\u2019ll also begin assembly for that once it arrives. <\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I started this week by continuing to work on the hand tracking pipeline\u2014mostly adding in two-handed tracking abilities. My main focus of the week was working with pianists on Wednesday. The hand tracking ran smoothly with the pianists and we were able to record some footage (linked here). I made a key discovery during the &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/2024\/09\/28\/shayes-status-report-for-9-28\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Shaye&#8217;s Status Report for 9\/28&#8221;<\/span><\/a><\/p>\n","protected":false},"author":978,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[10],"tags":[4,9],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/posts\/119"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/users\/978"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/comments?post=119"}],"version-history":[{"count":1,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/posts\/119\/revisions"}],"predecessor-version":[{"id":120,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/posts\/119\/revisions\/120"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/media?parent=119"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/categories?post=119"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/tags?post=119"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}