{"id":191,"date":"2021-04-04T03:37:13","date_gmt":"2021-04-04T03:37:13","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/?p=191"},"modified":"2021-04-04T04:03:32","modified_gmt":"2021-04-04T04:03:32","slug":"andys-status-report-for-4-3","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/2021\/04\/04\/andys-status-report-for-4-3\/","title":{"rendered":"Andy&#8217;s Status Report for 4\/3"},"content":{"rendered":"<p><strong>Work<\/strong>:<\/p>\n<ul>\n<li>Worked on color detection algorithm for specifically pink-colored tape<\/li>\n<li>I managed to find the HSV range that could detect neon pink. As shown in the video below, I was able to successfully differentiate mostly between the neon pink tape, my lip color, and the light pink of the fork. There are a few pixels that are sometimes detected elsewhere that do not match &#8220;neon pink&#8221; that I will continue to calibrate.<\/li>\n<li>Segmentation of the contours was a big issue, so I aimed to solve that this week. One solution for now is to only draw contours around areas that are of at least a certain size (100 px) for now. This helps reduce segmentation where the tape or object is fragmented into multiple areas with multiple contours. This also helps avoid drawing &#8220;mini contours&#8221; around very small pixels areas that sometimes are registered but not the tape-wrapped object.<\/li>\n<li>Lastly, I figured out how to use:\n<ul>\n<li>Trackbars to control the lower and upper HSV ranges. Before I was very inefficiently manually changing the HSV values and recompiling each time to test the masking.<\/li>\n<li>Getting and drawing the coordinates of the centroid of each contour on the live camera\/frame feed.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul>\n<li>I also managed to set up my Kinect sensor\/camera. I ran into a lot of issues setting it up on Windows with archived packages and outdated drivers and it would not connect to OpenCV at all or even output an image.<\/li>\n<li>I dug around online and eventually setup up a Ubuntu VM to connect to my Kinect. After a lot of trial and error I managed to connect the Kinect successfully to my VM, get a working image output, connect to OpenCV, and see the RGB image and the depth image.<\/li>\n<\/ul>\n<p><strong>Future:<\/strong><\/p>\n<ul>\n<li>Next week, I want to continue fine tuning the HSV range for neon pink in bright lighting. Additionally, I want to nearly completely eliminate segmentation and any false positives while drawing bounding boxes around each contour. I also want to be able to detect neon pink objects from far away (more preciseness needed) and integrate the depth sensor of the Kinect camera as well. I also want to remove an area on the feed for contour\/color detection as that will be our &#8220;basket&#8221; for already collected items. Finally, I will help Omar\/Hojun with the software\/hardware integration as we prep for our Demo.<\/li>\n<\/ul>\n<p>Here are some screenshots from my webcam during live video feed color detection testing.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-197\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/04\/image-300x76.png\" alt=\"\" width=\"529\" height=\"134\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/04\/image-300x76.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/04\/image-768x195.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/04\/image-1024x260.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-content\/uploads\/sites\/122\/2021\/04\/image.png 1990w\" sizes=\"(max-width: 529px) 100vw, 529px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p><iframe loading=\"lazy\" width=\"843\" height=\"632\" src=\"https:\/\/www.youtube.com\/embed\/9TcriLZ0bso?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Work: Worked on color detection algorithm for specifically pink-colored tape I managed to find the HSV range that could detect neon pink. As shown in&hellip;<\/p>\n","protected":false},"author":374,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[5],"tags":[6],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/posts\/191"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/users\/374"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/comments?post=191"}],"version-history":[{"count":5,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/posts\/191\/revisions"}],"predecessor-version":[{"id":200,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/posts\/191\/revisions\/200"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/media?parent=191"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/categories?post=191"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s21-teamb0\/wp-json\/wp\/v2\/tags?post=191"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}