Edward’s Status Update for 11/14
This week we had started off preparing for the first demo. Since we got chosen for a later date we met again to discuss if we would continue working on the project for the first demo. We spent time preparing through a practice demo amongst ourselves and had all the parts ready to demo for Vyas and Cindy. Given the new arrangements with the video passthrough, I realized that we can now fully utilize the two cameras set up. Since a lot of the code has already been written, this next week will consist of me working closely with Heather to test the correctness of the two cameras set up. I also plan to do some unit testing for the helper functions I wrote for the math component because that can lead to some annoying debugging if those are causing an issue. Although the device is correctly moving with respect to the detected faces, we still need to fine tune the calculations since we are currently assuming the lens is directly on the axis of rotation when it is not. The couple of inches away from the axis of rotation may lead to a small error right now but over time it may be accumulated for a large axis of rotation. Another big integration step that we hope to finish this week is the integration of the audio components. Once Anna gets that part done to some degree we can then begin basic integration but we can also test without that component done. The ability of the microphones to accurately detects a speaker will essentially determine how detailed the CV portion has to be since the algorithm may need to become more complex. I still plan on working on a program that optimizes the speaker detection in a camera frame but it might lead to a laggier camera feed.