{"id":18,"date":"2022-09-18T03:04:26","date_gmt":"2022-09-18T03:04:26","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/?page_id=18"},"modified":"2022-10-12T14:37:22","modified_gmt":"2022-10-12T14:37:22","slug":"introduction-and-project-summary","status":"publish","type":"page","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/introduction-and-project-summary\/","title":{"rendered":"Introduction and Project Summary"},"content":{"rendered":"<p>Self playing pianos have been around for a very long time, dating as far back as the 1900&#8217;s with pneumatic <a href=\"https:\/\/en.wikipedia.org\/wiki\/Player_piano\" target=\"_blank\" rel=\"noopener\">player pianos<\/a>. Our project uses an electro-mechanical self playing piano to reproduce human speech using piano notes. Our speech is composed of sound waves of <a href=\"https:\/\/en.wikipedia.org\/wiki\/Voice_frequency\" target=\"_blank\" rel=\"noopener\">various frequencies<\/a>. A piano key, when played,\u00a0 produces a note of a <a href=\"https:\/\/en.wikipedia.org\/wiki\/Piano_key_frequencies\" target=\"_blank\" rel=\"noopener\">specific frequency<\/a>. Multiple keys combined can evoke the phonemes of human speech, and allow a piano to speak and be understood.If you&#8217;re interested in hearing what something like that even sounds like, check out this <a href=\"https:\/\/www.youtube.com\/watch?v=uBEL3YVzMwk\" target=\"_blank\" rel=\"noopener\">video<\/a> from Mark Rober, where he demonstrates his talking piano. If you&#8217;d like to learn more about what goes in to building a talking piano, then make sure to visit our developer blogs during the semester!<\/p>\n<p>Here&#8217;s a brief overview of everything we&#8217;ll be working on:<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-large wp-image-49\" title=\"\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/09\/Self_Playing_Piano_Design2.drawio-1024x817.png\" alt=\"\" width=\"525\" height=\"419\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/09\/Self_Playing_Piano_Design2.drawio-1024x817.png 1024w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/09\/Self_Playing_Piano_Design2.drawio-300x239.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-content\/uploads\/sites\/216\/2022\/09\/Self_Playing_Piano_Design2.drawio-768x612.png 768w\" sizes=\"(max-width: 525px) 100vw, 525px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>The project has 4 main areas of development.<\/p>\n<p>Audio Processing and Streaming: Handles all the &#8216;math&#8217; involved with turning your voice into piano notes. At a really high level, every key on a piano corresponds to some frequency and our voice is also made up of several frequencies. Our goal is to find all the possible keys on a piano that match the frequencies that make up our voice using signal processing techniques like the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Fourier_transform\" target=\"_blank\" rel=\"noopener\">Fourier Transform<\/a> and <a href=\"https:\/\/en.wikipedia.org\/wiki\/Filter_(signal_processing)\" target=\"_blank\" rel=\"noopener\">filtering<\/a>.<\/p>\n<p>Piano Performance Scheduling: Takes care of a manipulating all the circuitry on-board the piano, and reproduces piano performances.<\/p>\n<p>Web Application: This is where all the controls for the piano are hosted. Here you can upload speech recordings, convert speech live, replay old recordings, and do many of the things you&#8217;d normally do on a music app like Spotify.<\/p>\n<p>Physical Piano Interface: This is the electro-mechanical system that presses all the keys on the piano!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Self playing pianos have been around for a very long time, dating as far back as the 1900&#8217;s with pneumatic player pianos. Our project uses an electro-mechanical self playing piano to reproduce human speech using piano notes. Our speech is composed of sound waves of various frequencies. A piano key, when played,\u00a0 produces a note &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/introduction-and-project-summary\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Introduction and Project Summary&#8221;<\/span><\/a><\/p>\n","protected":false},"author":631,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/pages\/18"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/users\/631"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/comments?post=18"}],"version-history":[{"count":8,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/pages\/18\/revisions"}],"predecessor-version":[{"id":114,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/pages\/18\/revisions\/114"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/f22-teamb2\/wp-json\/wp\/v2\/media?parent=18"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}