{"id":211,"date":"2023-04-29T22:23:28","date_gmt":"2023-04-29T22:23:28","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/?p=211"},"modified":"2023-04-29T22:23:28","modified_gmt":"2023-04-29T22:23:28","slug":"team-status-report-for-04-29-23","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/2023\/04\/29\/team-status-report-for-04-29-23\/","title":{"rendered":"Team Status Report for 04\/29\/23"},"content":{"rendered":"

The biggest change to our system at the moment is converting all of our features over to DLib.\u00a0 We are trying to make this change in time because doing so would increase our accuracies for testing in nonideal conditions.\u00a0 The costs incurred are that it will take time to make the switch as well as retest with the new model, and we don\u2019t have a definitive answer as to how this change will affect the current accuracies we have.\u00a0 However, we believe it is worth trying for the increase to the frame rate and more accurate head pose estimation.\u00a0 We will also continue testing what we currently have in the case that the change can\u2019t be made in time so we still have a good final product.<\/span><\/p>\n

Another risk we are currently having is related to integrating the full CV code onto the Jetson Nano. We were having issues installing tensorflow onto the Jetson, but the current problem is that the microSD card in the Jetson Nano is too small for our code and needed libraries. We have ordered a 128gb microSD card that will arrive on 04\/30, at which time we will set up the Jetson again with the new SD card and restart the process of installing the necessary libraries and be able to run our full code on the Jetson directly.<\/span><\/p>\n

We have pushed entire system testing on the Jetson again (to this upcoming week) because of issues we are having with integrating the CV subsystem code onto the Jetson Nano. We have also added tasks for converting head pose and mouth detection from CNN facial landmarks to DLib.\u00a0<\/span><\/p>\n\n\n\n\n\n\n\n\n\n\n\n\n\n
Unit Test<\/span><\/td>\nNotes<\/span><\/td>\n<\/tr>\n
Accelerometer (in Hamerschlag)<\/span><\/td>\nAcceleration data fluctuates significantly when the accelerometer is stationary \u2013 inaccurate acceleration measures also leads to inaccurate speed estimations. Need to still test in a moving car to determine feasibility of this unit.\u00a0<\/span><\/td>\n<\/tr>\n
Head pose estimation (CNN facial landmarks)<\/span><\/td>\nWhen tested pre-integration, head pose worked very accurately. However, the lower fps caused by integration makes the head pose ineffective. This led to the design change to convert Head pose and mouth detection from CNN to DLib because the use of the same algorithm for all of our components would decrease runtime and increase fps. Will need to retest after converting to DLib.\u00a0<\/span><\/td>\n<\/tr>\n
Mouth detection (CNN facial landmarks)<\/span><\/td>\nWorked accurately for both pre and post integration tests. Will need to retest after converting to DLib.\u00a0<\/span><\/td>\n<\/tr>\n
Eye-tracking<\/span><\/td>\nWorked accurately pre and post integration<\/span><\/td>\n<\/tr>\n
Blink detection<\/span><\/td>\nWorked accurately pre-integration, but fps was too low for accurate blink detection after integration. We are expecting performance to improve after\u00a0<\/span><\/td>\n<\/tr>\n
Connecting to WiFi hotspot in car and ssh-ing in<\/span><\/td>\nSet up the Jetson to auto-connect to Elinora\u2019s hotspot and checked that it was connected in the car. Did this 3x successfully in the car. There is a long connection time ~ 5 min and not waiting previously led us to think that the connection wasn\u2019t working.\u00a0<\/span><\/td>\n<\/tr>\n
Retrieving data from Firestore (in React) and displaying on the web app<\/span><\/td>\nCreated a test collection on Firestore and confirmed that the data from that test collection was retrieved and shown on the web app in table format.\u00a0<\/span><\/td>\n<\/tr>\n
Hosting the web app<\/span><\/td>\nAble to connect remotely from all 3 of our computers<\/span><\/td>\n<\/tr>\n
Firebase authentication<\/span><\/td>\nAble to create 3 accounts and log in.\u00a0<\/span><\/td>\n<\/tr>\n
Audio feedback<\/span><\/td>\nTested the speaker separately and then connected it to a laptop to play audio feedback integrated into the classification code. Audio feedback was played virtually instantaneously (passing our latency requirement)<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

The biggest change to our system at the moment is converting all of our features over to DLib.\u00a0 We are trying to make this change in time because doing so would increase our accuracies for testing in nonideal conditions.\u00a0 The costs incurred are that it will take time to make the switch as well as … <\/p>\n

Continue reading “Team Status Report for 04\/29\/23”<\/span><\/a><\/p>\n","protected":false},"author":661,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[9],"tags":[6],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/wp-json\/wp\/v2\/posts\/211"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/wp-json\/wp\/v2\/users\/661"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/wp-json\/wp\/v2\/comments?post=211"}],"version-history":[{"count":1,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/wp-json\/wp\/v2\/posts\/211\/revisions"}],"predecessor-version":[{"id":212,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/wp-json\/wp\/v2\/posts\/211\/revisions\/212"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/wp-json\/wp\/v2\/media?parent=211"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/wp-json\/wp\/v2\/categories?post=211"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamc5\/wp-json\/wp\/v2\/tags?post=211"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}