{"id":188,"date":"2022-04-04T14:14:45","date_gmt":"2022-04-04T14:14:45","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/?p=188"},"modified":"2022-04-04T14:14:45","modified_gmt":"2022-04-04T14:14:45","slug":"stellas-status-report-for-2-april-2022","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/2022\/04\/04\/stellas-status-report-for-2-april-2022\/","title":{"rendered":"Stella&#8217;s Status Report for 2 April 2022"},"content":{"rendered":"<p>This week, I debugged and tested the delay-and-sum beamforming algorithm with the goal of either getting delay-and-sum beamforming to successfully separate speech in our recordings, or showing that\u00a0delay-and-sum beamforming with our current mic array would not be sufficient to separate speech and that we should use a different approach.<\/p>\n<p>In order to test the\u00a0delay-and-sum beamforming algorithm, I first generated a sine wave audio in matlab. I played this sound through an earbud towards the mic at angle 0 on the mic array (mic 1).<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone  wp-image-189\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-content\/uploads\/sites\/201\/2022\/04\/E690E1CF-D6C1-4CB5-B252-4A32DB2BAD71_1_105_c-225x300.jpeg\" alt=\"\" width=\"178\" height=\"237\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-content\/uploads\/sites\/201\/2022\/04\/E690E1CF-D6C1-4CB5-B252-4A32DB2BAD71_1_105_c-225x300.jpeg 225w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-content\/uploads\/sites\/201\/2022\/04\/E690E1CF-D6C1-4CB5-B252-4A32DB2BAD71_1_105_c.jpeg 768w\" sizes=\"(max-width: 178px) 100vw, 178px\" \/><\/p>\n<p>I played the sine wave while recording from the mic array. Then, I passed the mic array recordings through my\u00a0delay-and-sum beamforming code. Though there was a lot of background noise, I found that beamforming towards the source (the earbud) gave an output with a greater SNR (judged by ear, not computationally) than beamforming away from the source. Below are the audio outputs for beamforming towards the source \u2013 look direction = 0 \u2013 and beamforming directly away from the source \u2013 look direction = pi.<\/p>\n<p>look direction = 0:<\/p>\n<!--[if lt IE 9]><script>document.createElement('audio');<\/script><![endif]-->\n<audio class=\"wp-audio-shortcode\" id=\"audio-188-1\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-content\/uploads\/sites\/201\/2022\/04\/look_0.wav?_=1\" \/><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-content\/uploads\/sites\/201\/2022\/04\/look_0.wav\">http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-content\/uploads\/sites\/201\/2022\/04\/look_0.wav<\/a><\/audio>\n<p>look direction = pi:<\/p>\n<audio class=\"wp-audio-shortcode\" id=\"audio-188-2\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-content\/uploads\/sites\/201\/2022\/04\/look_pi.wav?_=2\" \/><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-content\/uploads\/sites\/201\/2022\/04\/look_pi.wav\">http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-content\/uploads\/sites\/201\/2022\/04\/look_pi.wav<\/a><\/audio>\n<p>On Thursday, Charlie and I met with Dr. Stern to discuss alternative approaches to speech separation, particularly Phase Difference CHannel Weighting (PDCW) which Dr. Stern published. I got the beamforming test results (shared above) before this meeting, so we went in the goal of finding new algorithms to try rather than trying to get\u00a0delay-and-sum beamforming working.<\/p>\n<p>We are a bit behind schedule since we have decided to abandon\u00a0delay-and-sum beamforming in favor of a non-beamforming speech separation approach. To catch up this week, we will collect recordings that we can pass into the PDCW algorithm and determine how well this algorithm can separate speech with our mic setup.<\/p>\n<p>This week, Charlie and I will collect recordings that fit the assumptions of the PDCW algorithm and test the algorithm on them. From there, we will see what we can get working with the PDCW algorithm and we will meet up again with Dr. Stern to discuss our results and get some more guidance (as he suggested in our last meeting).<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This week, I debugged and tested the delay-and-sum beamforming algorithm with the goal of either getting delay-and-sum beamforming to successfully separate speech in our recordings, or showing that\u00a0delay-and-sum beamforming with our current mic array would not be sufficient to separate speech and that we should use a different approach. In order to test the\u00a0delay-and-sum beamforming &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/2022\/04\/04\/stellas-status-report-for-2-april-2022\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Stella&#8217;s Status Report for 2 April 2022&#8221;<\/span><\/a><\/p>\n","protected":false},"author":597,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[11],"tags":[9],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-json\/wp\/v2\/posts\/188"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-json\/wp\/v2\/users\/597"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-json\/wp\/v2\/comments?post=188"}],"version-history":[{"count":1,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-json\/wp\/v2\/posts\/188\/revisions"}],"predecessor-version":[{"id":192,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-json\/wp\/v2\/posts\/188\/revisions\/192"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-json\/wp\/v2\/media?parent=188"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-json\/wp\/v2\/categories?post=188"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s22-teamd6\/wp-json\/wp\/v2\/tags?post=188"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}