{"id":245,"date":"2022-04-16T22:44:49","date_gmt":"2022-04-17T02:44:49","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/?p=245"},"modified":"2022-04-16T15:06:13","modified_gmt":"2022-04-16T19:06:13","slug":"samuels-status-report-16-apr-22","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/2022\/04\/16\/samuels-status-report-16-apr-22\/","title":{"rendered":"Samuel&#8217;s Status Report &#8211; 16 Apr 22"},"content":{"rendered":"<p>This week I mostly helped Alex to build the platform for the camera setup, and then attempted some basic tests on the setup. I also am currently training a model based on the data collected from previous weeks (and some from this week after getting the platform up)<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-255 size-medium\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-content\/uploads\/sites\/184\/2022\/04\/platform1-169x300.jpg\" alt=\"\" width=\"169\" height=\"300\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-content\/uploads\/sites\/184\/2022\/04\/platform1-169x300.jpg 169w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-content\/uploads\/sites\/184\/2022\/04\/platform1-576x1024.jpg 576w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-content\/uploads\/sites\/184\/2022\/04\/platform1.jpg 720w\" sizes=\"(max-width: 169px) 100vw, 169px\" \/>\u00a0 <img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-256 size-medium\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-content\/uploads\/sites\/184\/2022\/04\/platform2-169x300.jpg\" alt=\"\" width=\"169\" height=\"300\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-content\/uploads\/sites\/184\/2022\/04\/platform2-169x300.jpg 169w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-content\/uploads\/sites\/184\/2022\/04\/platform2-576x1024.jpg 576w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-content\/uploads\/sites\/184\/2022\/04\/platform2.jpg 720w\" sizes=\"(max-width: 169px) 100vw, 169px\" \/><\/p>\n<p><em>Figure 1: Example of Fully-Constructed Platform <\/em><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-258\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-content\/uploads\/sites\/184\/2022\/04\/1649693589.1003754.png\" alt=\"\" width=\"100\" height=\"100\" \/> <img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-257\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-content\/uploads\/sites\/184\/2022\/04\/1649693538.516392.png\" alt=\"\" width=\"100\" height=\"100\" \/><\/p>\n<p><em>Figure 2: Example of self-collected data (here, of yellow squash) taken on new platform<\/em><\/p>\n<p>&nbsp;<\/p>\n<p>More notably, I have been trying to improve the robustness of the change detector since I predict issues with the CV algorithm falsely detecting a change due to illumination changes from the opening of the door or a person walking around etc.<\/p>\n<p>To this end, I tried using division normalization, where we divide the image by a very blurred version of the same image as per <a href=\"https:\/\/stackoverflow.com\/a\/64357685\/3141253\">https:\/\/stackoverflow.com\/a\/64357685\/3141253<\/a><\/p>\n<p>While this allowed the algorithm to be very robust against illumination it also reduced the sensitivity significantly. One particularly problematic aspect occured because my skin color was similar to the birch wood color and so my hand was &#8220;merged&#8221; into the background. When displaying with a red apple, however, there was a better response, but not always enough to trigger changes. With this in mind, we have plans to color the platform white and hope that this might cause a larger differential between natural colors like that of skin and fruit, vs those of the artificially white background.<\/p>\n<p>Another alternative is to play around with the saturation value of the HSV dimension. Or, since the main issue is going to be falsely detecting a change that moves the FSM into a background state falsely, we can potentially check for\u00a0 a true extra object using a Harris corner detector.<\/p>\n<p>Next week, in addition to trying the aforementioned items, I will also be helping to integrate the CV algorithm on the Jetson. We are currently on schedule but might need to speed up the integration component so we can spend more time on robustness testing.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This week I mostly helped Alex to build the platform for the camera setup, and then attempted some basic tests on the setup. I also am currently training a model based on the data collected from previous weeks (and some from this week after getting the platform up) \u00a0 Figure 1: Example of Fully-Constructed Platform &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/2022\/04\/16\/samuels-status-report-16-apr-22\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Samuel&#8217;s Status Report &#8211; 16 Apr 22&#8221;<\/span><\/a><\/p>\n","protected":false},"author":535,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[12,5,7],"tags":[],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-json\/wp\/v2\/posts\/245"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-json\/wp\/v2\/users\/535"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-json\/wp\/v2\/comments?post=245"}],"version-history":[{"count":4,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-json\/wp\/v2\/posts\/245\/revisions"}],"predecessor-version":[{"id":259,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-json\/wp\/v2\/posts\/245\/revisions\/259"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-json\/wp\/v2\/media?parent=245"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-json\/wp\/v2\/categories?post=245"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamb3\/wp-json\/wp\/v2\/tags?post=245"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}