{"id":76,"date":"2024-02-18T04:23:10","date_gmt":"2024-02-18T04:23:10","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/?p=76"},"modified":"2024-02-18T04:23:10","modified_gmt":"2024-02-18T04:23:10","slug":"nathalies-status-report-for-2-17","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/2024\/02\/18\/nathalies-status-report-for-2-17\/","title":{"rendered":"Nathalie&#8217;s Status Report for 2\/17"},"content":{"rendered":"<p><span style=\"font-weight: 400\">I spent this week outlining which hardware parts were going to be needed for each functionality piece. We broke down our hardware deliverables into two parts, the ARKit coverage mapping and back facing camera. The back-facing camera has a lot more hardware components like the Jetson, a Jetson-compatible camera, and the LED light. I spent a lot of time figuring out which components were good for our project and doing research on actual specs. Then I placed the orders for our parts through the Purchase Forms. We were going to use a Raspberry Pi but the one we wanted already had priority on the ECE inventory list so had to pick something else, the Jetson.<\/span><\/p>\n<p><span style=\"font-weight: 400\">I also installed Xcode and set up my developer environment, which I thought was going to be pretty quick but ran into some unexpected issues because Xcode requires a lot of disk space to download. I spent a few hours downloading a disk scanner so that I could delete things on my computer, backing it up to a hard drive, and then downloading the actual Xcode which was extremely slow. In the meantime, I was able to do some initial research on ARKit and how other people have mapped rooms\/floors in the past. I found this <a href=\"https:\/\/developer.apple.com\/augmented-reality\/roomplan\/\">room plan tool<\/a> that Apple has developed and maybe we can leverage since we plan on doing a simpler task of mapping just the floor, but a 3D plan of the room is helpful to determining where the borders of the floor are<\/span><span style=\"font-weight: 400\">. We can probably use this tool for our initial mapping of the room to develop our \u2018memory\u2019 feature. This <a href=\"https:\/\/www.youtube.com\/watch?v=fQkkkStm-vY&amp;ab_channel=NEXTREALITY\">floor plan anchor tool<\/a><\/span><span style=\"font-weight: 400\">\u00a0and <a href=\"https:\/\/www.youtube.com\/watch?v=JTDfzSPTRjA&amp;ab_channel=PatentlyApple\">mesh object detection and mapping<\/a><\/span><span style=\"font-weight: 400\">\u00a0is similar to what we want to accomplish when mapping the floor, especially when it comes to detecting which objects we don\u2019t want to include. There is an <a href=\"https:\/\/developer.apple.com\/documentation\/arkit\/arplaneanchor\/classification\/floor\">ARPlaneAnchor.Classification.floor<\/a><\/span><span style=\"font-weight: 400\">\u00a0that represents a real-world floor, ground plane, or similar large horizontal surface.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Plan is currently still on schedule but there isn\u2019t much slack left for these next parts so it\u2019s really important that our subsequent tasks are done on time.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">Next steps include making sure that our Jetson is able to boot (and reordering if needed), plus taking static images of dirt on the floor and feeding it into a dirt detection model to fully flush out our thresholds and make sure that the object detection model is able to perform in our context. After that, we are going to use the Jetson to perform the object detection mapping.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I spent this week outlining which hardware parts were going to be needed for each functionality piece. We broke down our hardware deliverables into two parts, the ARKit coverage mapping and back facing camera. The back-facing camera has a lot more hardware components like the Jetson, a Jetson-compatible camera, and the LED light. I spent &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/2024\/02\/18\/nathalies-status-report-for-2-17\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Nathalie&#8217;s Status Report for 2\/17&#8221;<\/span><\/a><\/p>\n","protected":false},"author":843,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/wp-json\/wp\/v2\/posts\/76"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/wp-json\/wp\/v2\/users\/843"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/wp-json\/wp\/v2\/comments?post=76"}],"version-history":[{"count":1,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/wp-json\/wp\/v2\/posts\/76\/revisions"}],"predecessor-version":[{"id":78,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/wp-json\/wp\/v2\/posts\/76\/revisions\/78"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/wp-json\/wp\/v2\/media?parent=76"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/wp-json\/wp\/v2\/categories?post=76"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teamc1\/wp-json\/wp\/v2\/tags?post=76"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}