{"id":202,"date":"2024-11-16T19:19:21","date_gmt":"2024-11-16T19:19:21","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/?p=202"},"modified":"2024-11-16T19:19:21","modified_gmt":"2024-11-16T19:19:21","slug":"shayes-status-report-for-11-16","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/2024\/11\/16\/shayes-status-report-for-11-16\/","title":{"rendered":"Shaye’s Status Report for 11\/16"},"content":{"rendered":"

This week my main objectives were to integrate my code onto the pi, gather more video from the pianists, and prepare for the interim demo next week.\u00a0<\/span><\/p>\n

For integration, I ported my pre-existing pipeline to rely on an accelerated blaze-based version of Mediapipe. I used code from this <\/span>repo<\/span><\/a> as the base to add my pipeline to. Currently, I\u2019ve included our old tension algorithm as a placeholder for the typical processing workload we\u2019d be doing with each frame. This will allow us to get a realistic estimate for our anticipated framerate (20 fps woo!). The modularity of the code will allow me to update the tension algorithm independently of the system running on the RPi, making future independent work straightforward. A video of this fully integrated with buzzer is linked <\/span>here<\/span><\/a>.\u00a0<\/span><\/p>\n

During our last session with Professor Dueck\u2019s students, I gathered more clips of the tense\/ non-tense technique playing. I also gathered some videos of students playing familiar & unfamiliar pieces and split them into 10 second clips\u2014Jessie will send out a form this weekend for the students to label these clips as tense\/ nonsense. This will become the data I\u2019ll use to verify that the tension algorithm uses.\u00a0<\/span><\/p>\n

Lastly, now that the system\u2019s been integrated more, I\u2019ll also start focusing on verifying my algorithm using the data gathered last week. My current plan is to run the system on the labeled clips, then comparing the output to label. I\u2019ll record the number of times we match the label, and the number of times we give false positives & false negatives for tension. If some results are inaccurate, I\u2019ll adjust some of the parameters for the algorithm and try the tests again. This would involve adding more span-based conditionals when looking for tension indicators, and adjusting the existing window size & convolution parameters from before.\u00a0<\/span><\/p>\n

Additionally, I\u2019ll use the technique clips to verify that output from the RPI matches the output from the Mediapipe-based pipeline running on my laptop. This means running the same test video on both systems, writing output information on tension to a text file, and comparing the textfiles to check that they are consistent. If they are, I\u2019ll be able to safely assume that any work on the tension algorithm on my laptop will produce the same result on the RPi, making integrated testing much easier as we\u2019ll only need to test the algorithm with my laptop.\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

This week my main objectives were to integrate my code onto the pi, gather more video from the pianists, and prepare for the interim demo next week.\u00a0 For integration, I ported my pre-existing pipeline to rely on an accelerated blaze-based version of Mediapipe. I used code from this repo as the base to add my … <\/p>\n

Continue reading “Shaye’s Status Report for 11\/16”<\/span><\/a><\/p>\n","protected":false},"author":978,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[10],"tags":[4,9],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/posts\/202"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/users\/978"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/comments?post=202"}],"version-history":[{"count":1,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/posts\/202\/revisions"}],"predecessor-version":[{"id":203,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/posts\/202\/revisions\/203"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/media?parent=202"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/categories?post=202"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f24-teamc4\/wp-json\/wp\/v2\/tags?post=202"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}