{"id":51,"date":"2019-03-22T01:56:32","date_gmt":"2019-03-22T01:56:32","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/?p=51"},"modified":"2019-03-22T01:56:32","modified_gmt":"2019-03-22T01:56:32","slug":"weekly-status-report-3-21","status":"publish","type":"post","link":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/2019\/03\/22\/weekly-status-report-3-21\/","title":{"rendered":"Weekly Status Report &#8211; 3\/21"},"content":{"rendered":"<p>I ended up spending a majority of Spring Break working on Capstone. It was not exactly expected but I enjoyed the programming and couldn&#8217;t get myself to stop.<\/p>\n<p>Anyways, as a product of that work, I was able to write a working MVP program that accomplishes many of our MVP objectives by fusing together my work with facial recognition and hand detection.<\/p>\n<p>That MVP script, using my webcam, does the following:<\/p>\n<ul>\n<li>detect faces (OpenCV). Hopefully, we can fuse Kevan&#8217;s work with detection to replace OpenCV&#8217;s here soon.<\/li>\n<li>recognize faces (my PCA + LDA = fisherfaces implementation from scratch) with &lt; 1 second delay. Thanks to a novel boosting algorithm I implemented, the accuracy on our training set increased to 70-80% on average. However, accuracy in real-life webcam usage is lower because the faces are seen in new enviroments (tilt, brightness, etc). Hopefully, Neeraj&#8217;s work with dlib and face regularizatoin can help with this.<\/li>\n<li>Detects hands raised at the height of the persons head or higher with 1 second delay. Fairly high accuracy (~75% or greater). Built all from scratch (except k-means algo). Re-learns each individuals face pigments every 10 seconds (takes about ~2 seconds)<\/li>\n<li>Records all recognition and hand detection and displays it in charts.<\/li>\n<li>Runs a suite of automatic tests on the recognition portion of the script. Displays results in useful charts.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p>I can&#8217;t summarize all of the things I did over break. But I will touch on the important ones.<\/p>\n<p>Novel Boosting Algo for Fisherfaces<\/p>\n<p>Our fisherfaces implementation was not generating the accuracy on out testing set that we wanted (about ~55% with 4 classes). I came up with a boosting algo where several iterations of unique fisherfaces were run and their results fused. Each iteration differed on mainly two factors: Firstly, they learned on somewhat different training sets. Thus, each learned in a unique way, yet still saw most of the training data so that each did better than random guessing. Secondly, each weak learner used a random image format when doing PCA, LDA (options include gray, red, blue, green; hue was deemed ineffective). Each weak learner voted on classification.<\/p>\n<p>&nbsp;<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-medium wp-image-52\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-content\/uploads\/sites\/48\/2019\/03\/53557097_276493679916829_1880030609934385152_n-300x143.png\" alt=\"\" width=\"300\" height=\"143\" srcset=\"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-content\/uploads\/sites\/48\/2019\/03\/53557097_276493679916829_1880030609934385152_n-300x143.png 300w, https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-content\/uploads\/sites\/48\/2019\/03\/53557097_276493679916829_1880030609934385152_n-768x366.png 768w, https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-content\/uploads\/sites\/48\/2019\/03\/53557097_276493679916829_1880030609934385152_n-1024x488.png 1024w, https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-content\/uploads\/sites\/48\/2019\/03\/53557097_276493679916829_1880030609934385152_n.png 1291w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/> <img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-medium wp-image-53\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-content\/uploads\/sites\/48\/2019\/03\/perf-charts-300x116.png\" alt=\"\" width=\"300\" height=\"116\" srcset=\"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-content\/uploads\/sites\/48\/2019\/03\/perf-charts-300x116.png 300w, https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-content\/uploads\/sites\/48\/2019\/03\/perf-charts-768x298.png 768w, https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-content\/uploads\/sites\/48\/2019\/03\/perf-charts-1024x397.png 1024w, https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-content\/uploads\/sites\/48\/2019\/03\/perf-charts.png 1590w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>I am currently far ahead of schedule.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I ended up spending a majority of Spring Break working on Capstone. It was not exactly expected but I enjoyed the programming and couldn&#8217;t get myself to stop. Anyways, as a product of that work, I was able to write a working MVP program that accomplishes many of our MVP objectives by fusing together my &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/2019\/03\/22\/weekly-status-report-3-21\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Weekly Status Report &#8211; 3\/21&#8221;<\/span><\/a><\/p>\n","protected":false},"author":146,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-json\/wp\/v2\/posts\/51"}],"collection":[{"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-json\/wp\/v2\/users\/146"}],"replies":[{"embeddable":true,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-json\/wp\/v2\/comments?post=51"}],"version-history":[{"count":1,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-json\/wp\/v2\/posts\/51\/revisions"}],"predecessor-version":[{"id":54,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-json\/wp\/v2\/posts\/51\/revisions\/54"}],"wp:attachment":[{"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-json\/wp\/v2\/media?parent=51"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-json\/wp\/v2\/categories?post=51"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/course.ece.cmu.edu\/~ece500\/projects\/s19-teamca\/wp-json\/wp\/v2\/tags?post=51"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}