{"id":171,"date":"2021-03-28T02:24:22","date_gmt":"2021-03-28T02:24:22","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/?p=171"},"modified":"2021-03-28T02:24:22","modified_gmt":"2021-03-28T02:24:22","slug":"andys-status-report-for-3-27","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/2021\/03\/28\/andys-status-report-for-3-27\/","title":{"rendered":"Andy&#8217;s Status Report for 3\/27"},"content":{"rendered":"<p><strong>Work<\/strong>:<\/p>\n<ul>\n<li>Worked on setting up OpenCV for my laptop webcam and run during live feed<\/li>\n<li>Kept running into a bug where my webcam failed to show anything &#8211;&gt; solved it by updating my webcam drivers manually<\/li>\n<li>Able to run color thresholding and draw contours during live video feed (images below)<\/li>\n<li>Tried to draw contours for some &#8220;pinkish&#8221; items like my yogurt fork and my pillow which it managed to do but still did not successfully detect the entire pillow\/fork yet. I am working on improving my thresholding to be able to draw the contour around the entire item. I also had some slight interference\/noise at times. For example, when I was testing on my fork, OpenCV also drew a contour around my lips as well. I need to make sure that I can filter out noise for all similar colors.<\/li>\n<\/ul>\n<p><strong>Future:<\/strong><\/p>\n<ul>\n<li>Next week, I am hoping to receive the Kinect Xbox camera, which has better color detection, fps, and depth perception. I will set that up and try to draw contours for different items during testing and gradually progress towards pinkish items and tools wrapped in neon pink tape. I also need to make sure to filter out all noise\/interference as possible from the background so only neon pink is detected.<\/li>\n<\/ul>\n<p>Here are some screenshots from my webcam during live video feed color detection testing.<\/p>\n<p>Initially, I connected webcam to OpenCV and just tried to detect my bright blue shirt. It also drew reflections around the blue reflections in my eyes.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-medium wp-image-175\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/shirt-300x131.png\" alt=\"\" width=\"300\" height=\"131\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/shirt-300x131.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/shirt-768x335.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/shirt-1024x447.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/shirt.png 1290w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>I was trying to only draw the contours for my spoons but my lips were detected as pinkish as well.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-medium wp-image-173\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/pink-300x133.png\" alt=\"\" width=\"300\" height=\"133\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/pink-300x133.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/pink-768x340.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/pink-1024x453.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/pink.png 1285w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>Tried to use an orange\/pink? pillow and moved it around. Since I set the threshold for a deeper hue\/saturation, the pink? spoon was not detected this time while the pillow was. I am trying to figure out the right thresholding to account for the glare and lighting so that the entire pillow is detected.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-medium wp-image-174\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/red-300x132.png\" alt=\"\" width=\"300\" height=\"132\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/red-300x132.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/red-768x339.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/red-1024x452.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/03\/red.png 1288w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Work: Worked on setting up OpenCV for my laptop webcam and run during live feed Kept running into a bug where my webcam failed to&hellip;<\/p>\n","protected":false},"author":374,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[5],"tags":[6],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/posts\/171"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/users\/374"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/comments?post=171"}],"version-history":[{"count":1,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/posts\/171\/revisions"}],"predecessor-version":[{"id":177,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/posts\/171\/revisions\/177"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/media?parent=171"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/categories?post=171"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/tags?post=171"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}