Browsed by
Author: elucero

Team Status Update for 12/5

Team Status Update for 12/5

This past week, we worked on integrating,testing, and collecting metrics. We met up multiple times throughout the week, staying on call with each other while Heather assembled the physical device and troubleshooting together. We at least put together all the pieces — motor control, CV face detection, and acoustic location — and inevitably ran into bugs along the way. Our biggest hurdles were occasional crashes, laggy video feed, both audio and video detection having sporadic wildly off readings, and the…

Read More Read More

Edward’s Status Update for 12/5

Edward’s Status Update for 12/5

This week was the final push for integration. I met up almost daily with Heather and Anna to make sure that everything was connected properly. I also had to program a lot more solutions since we also changed how the motors would be moving. The motors still had a limited range but in order to still center a face in those cases I manually cropped the frame as much as possible to then add a black border to create an…

Read More Read More

Edward’s Status Update for 11/21

Edward’s Status Update for 11/21

This week I spent time to better enhance the video feed that was being passed to the computer. It was easier than expected since we only needed to change how our windows were instantiated. After doing so I then began the code to better detect a speaker when there are multiple faces. The algorithm is still quite naive but in order to increase correctness I went about to consider the following things. The first was to account for issues caused…

Read More Read More

Team Status Update for 11/14

Team Status Update for 11/14

For the audio, Anna has been looking into various kinds of microphones and ADCs and recently obtained a new ADC with a maximum sampling rate of 200kSPS. However, they have come to the realization that, without a dedicated microcontroller with a real-time OS, we cannot achieve this max sampling rate, since the Jetson runs Linux, a general-purpose OS. We will only be able to get a fraction of 200sps, but this could still be adequate for our purposes. We just…

Read More Read More

Edward’s Status Update for 11/14

Edward’s Status Update for 11/14

This week we had started off preparing for the first demo. Since we got chosen for a later date we met again to discuss if we would continue working on the project for the first demo. We spent time preparing through a practice demo amongst ourselves and had all the parts ready to demo for Vyas and Cindy. Given the new arrangements with the video passthrough, I realized that we can now fully utilize the two cameras set up. Since…

Read More Read More

Edward’s Status Update for 11/7

Edward’s Status Update for 11/7

So this week I was able to make some more progress with Heather in terms of getting a video feed through to a computer. We were able to send a receive video through gstreamer from the nano to the computer and see some of the frames. The big issue that still remains here is that the streaming of the bits may not be fast enough but we might be able to make use of a better streaming protocol using ethernet…

Read More Read More

Edward’s Status Update for 10/31

Edward’s Status Update for 10/31

Earlier this week I was able to restructure the code that we previously used for testing and merged it into the new framework. It still needs a little more robust testing and the new servo motor control still needs to be added back in since right now the motors that do work are just the stepper motors. I also finally defined the final messages that will be sent to motors and that are expected by each of the programs. If…

Read More Read More

Edward’s Status Update for 10/24

Edward’s Status Update for 10/24

Early in the week we spent finalizing the last portions of the design report. We all spent time proofreading the document and writing the last couple of paragraphs. After that I focused primarily on the integration between different components of the project. With the first demo coming so soon we felt that cutting out some of the software features and implementing them later was a better approach so we decided to start with integration The first thing I did this…

Read More Read More

Edward’s Status Update for 10/17

Edward’s Status Update for 10/17

This week the team’s overall deliverable of the design review report led to me spending a lot of time on that rather than additional development on the software code base. We spent the beginning of the week wrapping up the presentation slides on Sunday which ate a chunk of my time. In the middle of the week I spent time looking into the additional libraries we could use for the concurrency and came to the conclusion that using the base…

Read More Read More

Team’s Status Update for 10/17

Team’s Status Update for 10/17

This week, the team’s major goals revolved around the design review. At the beginning of the week, we prepared our slides for the presentation, which Anna delivered on Wednesday. After that, we promptly began putting together our design review paper. Luckily, the solid effort we had put into the slides made the paper process much easier, as we already had a substantial template to work off of from the presentation. A big takeaway from the design presentation was the realization…

Read More Read More