{"id":158,"date":"2023-03-19T03:39:37","date_gmt":"2023-03-19T03:39:37","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/?p=158"},"modified":"2023-03-19T03:39:37","modified_gmt":"2023-03-19T03:39:37","slug":"lees-status-report-for-3-18-2023","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/2023\/03\/19\/lees-status-report-for-3-18-2023\/","title":{"rendered":"Lee\u2019s Status Report for 3\/18\/2023"},"content":{"rendered":"<p><strong><span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">What<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">did<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">you<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">personally<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">accomplish<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">this<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">week<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">on<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">the<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">project?<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">Give<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">files<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">or<\/span> <\/strong><br class=\"textLayer--absolute\" role=\"presentation\" \/><strong><span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">photos<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">that<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">demonstrate<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">your<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">progress.<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">Prove<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">to<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">the<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">reader<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">that<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">you<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">put<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">sufficient\u00a0<\/span><span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">effort<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">into<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">the<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">project<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">over<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">the<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">course<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">of<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">the<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">week<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">(12+<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">hours).<\/span><\/strong><\/p>\n<p>This past week I worked on the CV code to segment out black keys. I first started by obtaining test images from online that were just top down view to start off. Then, I created functions to input those test images from my hard drive to run the algorithms on them. I first started off with changing it to grayscale. Then I put a gaussian blur on it to prepare it for putting edge detection onto it. Lastly, I decided to put a sobel filter for horizontal and vertical edge detection to obtain the image below:<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-160\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-content\/uploads\/sites\/233\/2023\/03\/status-report-3-18-23.png\" alt=\"\" width=\"1920\" height=\"1034\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-content\/uploads\/sites\/233\/2023\/03\/status-report-3-18-23.png 1920w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-content\/uploads\/sites\/233\/2023\/03\/status-report-3-18-23-300x162.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-content\/uploads\/sites\/233\/2023\/03\/status-report-3-18-23-768x414.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-content\/uploads\/sites\/233\/2023\/03\/status-report-3-18-23-1024x551.png 1024w\" sizes=\"(max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/p>\n<p>Furthermore, the camera attatchment for the laptop and phone came in and we put it on the laptop with the phone on it to see if it worked and it was able to point down at the direction we desired. We did not take a photo of it during class but an image of what this looks like can be found on the amazon store:<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-163\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-content\/uploads\/sites\/233\/2023\/03\/status-report-3-18-23-1.png\" alt=\"\" width=\"705\" height=\"698\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-content\/uploads\/sites\/233\/2023\/03\/status-report-3-18-23-1.png 705w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-content\/uploads\/sites\/233\/2023\/03\/status-report-3-18-23-1-150x150.png 150w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-content\/uploads\/sites\/233\/2023\/03\/status-report-3-18-23-1-300x297.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-content\/uploads\/sites\/233\/2023\/03\/status-report-3-18-23-1-100x100.png 100w\" sizes=\"(max-width: 705px) 100vw, 705px\" \/><\/p>\n<p>I also did some further research with finding out several ways to look at doing warp perspective since the view will not always be top-bottom view. I came up with 3 ideas. 1. Have the student choosing (clicking) points on the streaming video to choose where the piano is. 2. Use feature matching by passing in an image of the top-down view of the piano. 3. Add a red border so the CV algorithm recognizes the 4 corner points of the piano. After speaking with Tamal, he suggested changing the actual attachment itself to a goose neck, phone holder, tri-pod ring light mechanism. This would give it the flexibility to reach over and look down from a top-down view making our lives easier. Additionally, the ring light was a great suggestion since he said that lighting conditions could greatly affect the CV algorithm so it was importatnt to make this a control element rather than a variable. For corner points,\u00a0 he said red border would be best, or you even make the corners plus signs and just do feature matching for the plus signs to easily identify it. I will certainly take these into considerations.<\/p>\n<p>Lastly, I worked on doingthe ethics assignment this week too. This includes reading through the two articles and completing tasks 1 and 2 of the assignment.<\/p>\n<p><strong><span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">&#8220;<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">Is<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">your<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">progress<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">on<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">schedule<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">or<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">behind?<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">If<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">you<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">are<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">behind,<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">what<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">actions<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">will<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">be\u00a0<\/span><span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">taken<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">to<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">catch<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">up<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">to<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">the<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">project<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">schedule?<\/span><\/strong><\/p>\n<p>My progress is a bit behind as the black keys need to be segmented. However, all I need to do is put a binary threshold filter on it to filter out white vs black keys. Since we have edge detection achieved, I will use a segmentation function to add distinct values to the binary values of pixels and borders of the edge detection. So I will be working on that tomorrow before the start of the week on Monday.<\/p>\n<p><strong><span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">&#8220;<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">What<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">deliver<\/span><span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">ables<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">do<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">you<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">hope<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">to<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">complete<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">in<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">the<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">next<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">week?<\/span> <\/strong><\/p>\n<p>By next week according to the schedule, I will have the white keys also segmented too. Additionally, I plan to have choose the goose neck phone holder ring light tri-pod amazon product on Monday during class to have it sent to the order form by Tuesday to get that in early. This will not stunt by progress since I am relying on test images still. I also will talk to my group mates on the task 3 of the ethics assignment where we discuss that and take ntoes. I also want to work on adding the corner point plus signs to the test images to see how well the warp perspective performance will do.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient\u00a0effort into the project over the course of the week (12+ hours). This past week I worked on the CV code to segment out black keys. I first started by &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/2023\/03\/19\/lees-status-report-for-3-18-2023\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Lee\u2019s Status Report for 3\/18\/2023&#8221;<\/span><\/a><\/p>\n","protected":false},"author":738,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[7],"tags":[9],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-json\/wp\/v2\/posts\/158"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-json\/wp\/v2\/users\/738"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-json\/wp\/v2\/comments?post=158"}],"version-history":[{"count":2,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-json\/wp\/v2\/posts\/158\/revisions"}],"predecessor-version":[{"id":166,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-json\/wp\/v2\/posts\/158\/revisions\/166"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-json\/wp\/v2\/media?parent=158"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-json\/wp\/v2\/categories?post=158"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamb6\/wp-json\/wp\/v2\/tags?post=158"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}