{"id":233,"date":"2022-12-11T06:32:11","date_gmt":"2022-12-11T06:32:11","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/?p=233"},"modified":"2022-12-11T06:32:11","modified_gmt":"2022-12-11T06:32:11","slug":"marcos-status-report-12-10-2022","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/2022\/12\/11\/marcos-status-report-12-10-2022\/","title":{"rendered":"Marco&#8217;s Status Report 12\/10\/2022"},"content":{"rendered":"<p>This week, I finished implementing the audio reconstruction pipeline which allows us to listen to the audio being extracted by the SDFT bins.<\/p>\n<p>As a reminder, my goal was to take an original audio of someones voice (see first audio sample below), and the extract the frequencies present in a user&#8217;s voice that correspond to the frequencies of piano keys. However, we&#8217;d have no idea if we&#8217;re extracting enough information by only using the power present at the piano key frequencies \u2014 therefore we needed to somehow reconstruct an audio file using the frequencies we picked up.<\/p>\n<div id=\"1670447188.121629\" class=\"c-virtual_list__item c-virtual_list__item--initial-activeitem\" role=\"listitem\">\n<div class=\"c-message_kit__background p-message_pane_message__message c-message_kit__message p-message_pane_message__message--showing_context_bar\" role=\"presentation\">\n<div class=\"c-message_kit__hover\" role=\"document\">\n<div class=\"c-message_kit__actions c-message_kit__actions--above\">\n<div class=\"c-message_kit__gutter\">\n<div class=\"c-message_kit__gutter__right\" role=\"presentation\">\n<div class=\"c-message_kit__blocks c-message_kit__blocks--rich_text\">\n<div class=\"c-message__message_blocks c-message__message_blocks--rich_text\">\n<div class=\"p-block_kit_renderer\">\n<div class=\"p-block_kit_renderer__block_wrapper p-block_kit_renderer__block_wrapper--first\">\n<div class=\"p-rich_text_block\" dir=\"auto\">\n<div class=\"p-rich_text_section\">I generated the reconstructed audio by multiplying the reconstructed samples with an exponential decay function so that the frequencies could be sustained for long enough like they would be on a piano.<\/div>\n<div><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div id=\"1670447310.348259\" class=\"c-virtual_list__item\" role=\"listitem\">\n<div class=\"c-message_kit__background c-message_kit__background--hovered p-message_pane_message__message c-message_kit__message p-message_pane_message__message--showing_context_bar\" role=\"presentation\">\n<div class=\"c-message_kit__hover c-message_kit__hover--hovered\" role=\"document\">\n<div class=\"c-message_kit__actions c-message_kit__actions--above\">\n<div class=\"c-message_kit__gutter\">\n<div class=\"c-message_kit__gutter__right\" role=\"presentation\">\n<div class=\"c-message_kit__blocks c-message_kit__blocks--rich_text\">\n<div class=\"c-message__message_blocks c-message__message_blocks--rich_text\">\n<div class=\"p-block_kit_renderer\">\n<div class=\"p-block_kit_renderer__block_wrapper p-block_kit_renderer__block_wrapper--first\">\n<div class=\"p-rich_text_block\" dir=\"auto\">\n<div class=\"p-rich_text_section\">The first image is the original audio, the second image uses the exponential function y=Ae^((-0.001)x), and the third image uses the exponential decay function y=Ae^((-0.0001)x). Below each image is it&#8217;s corresponding audio.<\/div>\n<div><\/div>\n<div>Please lower you&#8217;re computer volume before playing the following recordings, they are a bit choppy.<\/div>\n<div><\/div>\n<\/div>\n<div><strong>Original Audio<\/strong><\/div>\n<div class=\"p-rich_text_block\" dir=\"auto\">\n<div><\/div>\n<div><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-large wp-image-237\" title=\"\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.06.39-PM-1024x565.png\" alt=\"\" width=\"525\" height=\"290\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.06.39-PM-1024x565.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.06.39-PM-300x166.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.06.39-PM-768x424.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.06.39-PM.png 1134w\" sizes=\"(max-width: 525px) 100vw, 525px\" \/><\/div>\n<div>\n<!--[if lt IE 9]><script>document.createElement('audio');<\/script><![endif]-->\n<audio class=\"wp-audio-shortcode\" id=\"audio-233-1\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/marco_speech_18_500.wav?_=1\" \/><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/marco_speech_18_500.wav\">http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/marco_speech_18_500.wav<\/a><\/audio>\n<\/div>\n<div>\n<p><strong>Reconstructed Audio r[n] using Decay y[n] = e^((-0.001)x)<\/strong><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-large wp-image-238\" title=\"\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.06.52-PM-1024x576.png\" alt=\"\" width=\"525\" height=\"295\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.06.52-PM-1024x576.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.06.52-PM-300x169.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.06.52-PM-768x432.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.06.52-PM.png 1166w\" sizes=\"(max-width: 525px) 100vw, 525px\" \/><\/p>\n<audio class=\"wp-audio-shortcode\" id=\"audio-233-2\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/reconstructed_audio_001.wav?_=2\" \/><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/reconstructed_audio_001.wav\">http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/reconstructed_audio_001.wav<\/a><\/audio>\n<p><strong>Reconstructed Audio r[n] using Decay y[n]=e^((-0.0001)x)<\/strong><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-large wp-image-239\" title=\"\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.07.02-PM-1024x569.png\" alt=\"\" width=\"525\" height=\"292\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.07.02-PM-1024x569.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.07.02-PM-300x167.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.07.02-PM-768x427.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/Screen-Shot-2022-12-07-at-4.07.02-PM.png 1076w\" sizes=\"(max-width: 525px) 100vw, 525px\" \/><\/p>\n<audio class=\"wp-audio-shortcode\" id=\"audio-233-3\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/reconstructed_audio_0001.wav?_=3\" \/><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/reconstructed_audio_0001.wav\">http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/12\/reconstructed_audio_0001.wav<\/a><\/audio>\n<\/div>\n<div>\n<p>&nbsp;<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>This week, I finished implementing the audio reconstruction pipeline which allows us to listen to the audio being extracted by the SDFT bins. As a reminder, my goal was to take an original audio of someones voice (see first audio sample below), and the extract the frequencies present in a user&#8217;s voice that correspond to &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/2022\/12\/11\/marcos-status-report-12-10-2022\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Marco&#8217;s Status Report 12\/10\/2022&#8221;<\/span><\/a><\/p>\n","protected":false},"author":633,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/posts\/233"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/users\/633"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/comments?post=233"}],"version-history":[{"count":1,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/posts\/233\/revisions"}],"predecessor-version":[{"id":240,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/posts\/233\/revisions\/240"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/media?parent=233"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/categories?post=233"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/tags?post=233"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}