{"id":141,"date":"2021-11-06T17:20:57","date_gmt":"2021-11-06T21:20:57","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/?p=141"},"modified":"2021-11-06T17:20:57","modified_gmt":"2021-11-06T21:20:57","slug":"bhumika-kapurs-status-report-for-11-6","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/2021\/11\/06\/bhumika-kapurs-status-report-for-11-6\/","title":{"rendered":"Bhumika Kapur&#8217;s Status Report for 11\/6"},"content":{"rendered":"<p>This week I worked on all three components of my part of the project, the laser detection algorithm, the April tag detection, and the edge detection.<\/p>\n<p>For the edge detection, I was able to implement edge detection directly from the Intel RealSense&#8217;s stream, with very low latency. The edge detection also appears to be fairly accurate and is able to recognize most of the edges I tested it on. The results are shown below:<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\" wp-image-142 aligncenter\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-150514_1312x517_scrot-300x118.png\" alt=\"\" width=\"462\" height=\"182\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-150514_1312x517_scrot-300x118.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-150514_1312x517_scrot-768x303.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-150514_1312x517_scrot-1024x404.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-150514_1312x517_scrot.png 1312w\" sizes=\"(max-width: 462px) 100vw, 462px\" \/><\/p>\n<p>Next I worked on the laser detection. I improved my algorithm so that it would result in an image with a white dot at the location of the laser if it is in the frame, and black everywhere else. I did this by thresholding for pixels that are red and above a certain brightness. Currently this algorithm works decently well but is not 100% accurate in some lighting conditions. The algorithm is also fairly fast and I was able to apply it to each frame from my stream. The results are shown below:<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\" wp-image-143 aligncenter\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-151021_1303x500_scrot-300x115.png\" alt=\"\" width=\"404\" height=\"155\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-151021_1303x500_scrot-300x115.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-151021_1303x500_scrot-768x295.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-151021_1303x500_scrot-1024x393.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-151021_1303x500_scrot.png 1303w\" sizes=\"(max-width: 404px) 100vw, 404px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>Finally I worked on the April Tag detection code. I decided to use a different April Tag python library than the one I was previously using as this new library returns more specific information such as the homography matrix. I am a bit unsure as to how I can use this information to calculate the exact 3D position of the tag, but I plan to look into this more in the next few days. The results are below:<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\" wp-image-144 aligncenter\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-151402_1391x444_scrot-300x96.png\" alt=\"\" width=\"428\" height=\"137\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-151402_1391x444_scrot-300x96.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-151402_1391x444_scrot-768x245.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-151402_1391x444_scrot-1024x327.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-content\/uploads\/sites\/167\/2021\/11\/2021-11-06-151402_1391x444_scrot.png 1391w\" sizes=\"(max-width: 428px) 100vw, 428px\" \/><\/p>\n<p>During the upcoming week I plan to improve the April Tag detection so I can get the exact 3D location and, and also work on integrating these algorithms with the navigation of the robot.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This week I worked on all three components of my part of the project, the laser detection algorithm, the April tag detection, and the edge detection. For the edge detection, I was able to implement edge detection directly from the Intel RealSense&#8217;s stream, with very low latency. The edge detection also appears to be fairly &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/2021\/11\/06\/bhumika-kapurs-status-report-for-11-6\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Bhumika Kapur&#8217;s Status Report for 11\/6&#8221;<\/span><\/a><\/p>\n","protected":false},"author":506,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[9],"tags":[12],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-json\/wp\/v2\/posts\/141"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-json\/wp\/v2\/users\/506"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-json\/wp\/v2\/comments?post=141"}],"version-history":[{"count":1,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-json\/wp\/v2\/posts\/141\/revisions"}],"predecessor-version":[{"id":145,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-json\/wp\/v2\/posts\/141\/revisions\/145"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-json\/wp\/v2\/media?parent=141"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-json\/wp\/v2\/categories?post=141"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f21-teama4\/wp-json\/wp\/v2\/tags?post=141"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}