{"id":66,"date":"2019-03-09T23:52:46","date_gmt":"2019-03-09T23:52:46","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/?p=66"},"modified":"2019-03-10T02:48:47","modified_gmt":"2019-03-10T02:48:47","slug":"status-report-3-3-3-9","status":"publish","type":"post","link":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/2019\/03\/09\/status-report-3-3-3-9\/","title":{"rendered":"Status Report (3\/3 &#8211; 3\/9)"},"content":{"rendered":"<h2>Team Report<\/h2>\n<h3><span style=\"font-weight: 400\">Changes to schedule:<\/span><\/h3>\n<p><span style=\"font-weight: 400\">We don\u2019t have any current changes to our schedule. <\/span><\/p>\n<h3><span style=\"font-weight: 400\">Major project changes:<\/span><\/h3>\n<p><span style=\"font-weight: 400\">We don\u2019t have any major project changes at this point.<\/span><\/p>\n<h2>Brandon<\/h2>\n<p><span style=\"font-weight: 400\">For the fourth week of work on the project, I focused on the video streaming\/sending functionality. Unfortunately, I had to redo my order form, and add in a bunch of other stuff (power cables, sd cards, etc\u2026), so we didn\u2019t get our materials this week. This pushed back a lot of what I planned to do, since I didn\u2019t have access to the Pis. Regardless, I was able to work on the sending of 2D arrays, along with converting the frame from a 3D RGB array of pixels to a 2D grayscale array using numpy tools. Here is the process from our design document:<\/span><\/p>\n<p><span style=\"font-weight: 400\">We plan on sending 1280&#215;720 grayscale frames across UDP. The Raspberry Pi will capture the frame as an RGB array, which we will convert into a grayscale array. Each frame then contains 921,600 pixels, which are each represented by one byte, as a grayscale image can represent pixels at 8 bpp (bits per pixel). This results in a total of 921,600 total bytes. These bytes will be stored in a 2-dimensional array with the row and column of the pixel as the indices. Since we can\u2019t send the entire array in one packet over UDP, we will tentatively plan to send each row separately, resulting in 720 bytes per packet, and reconstruct the array on the receiving end.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Once I pick up the Pis from Quinn, I\u2019ll be able to truly start working on the video capture part of the project, constructing the camera packs and using the Pis to record video, which will be converted to grayscale and hopefully displayed on a monitor. Once I get that working, I can then begin sending these arrays over to the FPGA ARM core for processing.<\/span><\/p>\n<p><span style=\"font-weight: 400\">I\u2019m still slightly behind schedule, but again, I plan on working a bit over Spring Break this upcoming week (even though I wasn\u2019t originally planning to) to catch up. Once we get our materials from Quinn, everything should accelerate nicely. The deliverables I hope to achieve throughout the next two weeks include actually demonstrating the RGB -&gt; grayscale transition on a visual output, along with acquiring and orienting with the materials.<\/span><\/p>\n<h2>Edric<\/h2>\n<p>This week, we got our design report document finished. It was a good opportunity to see where our planning is lacking. As a result, the higher-level decisions for our system architecture is now finished.<\/p>\n<p>I worked with Ilan to get some preliminary numbers down. We now have a reasonable estimate on how many resources (in terms of DSP slices) a compute block will take based on the number of multiplications and adds each phase the Canny edge detection algorithm takes. Using an approximate pipeline design and a clock frequency from the Ultra96&#8217;s datasheet, we now have an estimate on how long a frame will take to process, which came down to about 15ms. The next step is to start on the Gaussian blur implementation.<\/p>\n<p>As for Ultra96 things, now that we have a power supply we can start playing with it. We&#8217;ve been using their guide on getting a Vivado project for the U96 running, and Ilan is going to try to get some flashing lights on the board over break.<\/p>\n<p>One concern I have at the moment is flashing designs on to the board. To flash over USB we need an adapter, but apparently there is a possibility of doing so via the ARM core. More investigation is warranted.<\/p>\n<p>I think we&#8217;re decently on schedule. Once we get back from break we should be able to begin actual implementation.<\/p>\n<h2>Ilan<\/h2>\n<h3><span style=\"font-weight: 400\">Personal accomplishments this week:<\/span><\/h3>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Finalized target clock frequency and DSP slice allocation.<\/span>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Was tricky since we didn\u2019t fully understand all of the phases of the algorithm at the beginning, but just required more research to better understand the computation pattern and how many DSP slices are necessary.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Future work will be if we see that we need more DSP slices, we\u2019ll need to pull from the reserve 52\/180 per stream.<\/span><\/li>\n<\/ul>\n<\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Finished design review documentation<\/span>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Big focus by Edric and myself on getting quantifiable numbers around everything, including target clock frequency and DSP slice allocation above.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Better diagramming different parts of the system and making sure our design is fully understood by both of us.<\/span><\/li>\n<\/ul>\n<\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Continued working on bringing up FPGA and ARM core. Still working on finalizing infrastructure and toolchain so it works for all 3 of us.<\/span>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Part of this will be seeing how HLS fits in and how easy it is for us to use.<\/span>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">I\u2019ll be looking into this over spring break.<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h3><span style=\"font-weight: 400\">Progress on schedule:<\/span><\/h3>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Schedule is on target, and I will be trying to do a little bit of work over spring break to get us some more slack during the second half of the semester<\/span><\/li>\n<\/ul>\n<h3><span style=\"font-weight: 400\">Deliverables next week:<\/span><\/h3>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Finish enabling ARM core and FPGA functionality and pushing toolchain up to GitHub and documenting setup.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Get infrastructure working.<\/span><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Team Report Changes to schedule: We don\u2019t have any current changes to our schedule. Major project changes: We don\u2019t have any major project changes at this point. Brandon For the fourth week of work on the project, I focused on the video streaming\/sending functionality. Unfortunately, I had to redo my order form, and add in &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/2019\/03\/09\/status-report-3-3-3-9\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Status Report (3\/3 &#8211; 3\/9)&#8221;<\/span><\/a><\/p>\n","protected":false},"author":101,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/wp-json\/wp\/v2\/posts\/66"}],"collection":[{"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/wp-json\/wp\/v2\/users\/101"}],"replies":[{"embeddable":true,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/wp-json\/wp\/v2\/comments?post=66"}],"version-history":[{"count":5,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/wp-json\/wp\/v2\/posts\/66\/revisions"}],"predecessor-version":[{"id":72,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/wp-json\/wp\/v2\/posts\/66\/revisions\/72"}],"wp:attachment":[{"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/wp-json\/wp\/v2\/media?parent=66"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/wp-json\/wp\/v2\/categories?post=66"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamab\/wp-json\/wp\/v2\/tags?post=66"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}