{"id":160,"date":"2023-03-17T16:45:11","date_gmt":"2023-03-17T20:45:11","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/?p=160"},"modified":"2023-03-17T16:46:57","modified_gmt":"2023-03-17T20:46:57","slug":"nina-duans-status-report-for-3-18-2023","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/2023\/03\/17\/nina-duans-status-report-for-3-18-2023\/","title":{"rendered":"Nina Duan\u2019s Status Report For 3\/18\/2023"},"content":{"rendered":"
Personal Accomplishment<\/b><\/h6>\n

In addition to completing the ethics assignment, I integrated our database module and preliminary NLP module with Lisa and modified the microphone & speech recognition system provided by Python\u2019s SpeechRecognition library.<\/span><\/p>\n

After integration, our system is now able to extract menu items and quantities from simple sentences, add them to an Order object, and upload that object to the database. However, there are still flaws with this simple system because we have yet to implement the checkout portion of the NLP module.<\/span><\/p>\n

The open-source SpeechRecognition library provides a basic real-time speech recognition functionality that can be used with an external microphone. This process, however, doesn\u2019t allow room for noise reduction. Therefore, I explored the source code of the library, determined where the microphone\u2019s input is read, and extended it to utilize a noise reduction algorithm. For now, it uses a simple, deterministic noise cancellation algorithm that attempts to cancel out low amplitudes by mixing with the signal\u2019s inversion. By slightly altering <\/span>this visualization tool<\/span><\/a>, I was able to visualize the difference. This is what it looks like when I speak at conversational volume from a distance of ~0.7m, with a restaurant\u00a0<\/span>ambience noise YouTube video playing in the background (graphs are in time domain; top = raw microphone input, bottom = filtered input):<\/span><\/p>\n

\"\"
No speech, only noise.<\/figcaption><\/figure>\n
\"\"
Speech with noise, with amplitude decreased.<\/figcaption><\/figure>\n
About Schedule<\/b><\/h6>\n

I have caught up to the schedule. The microphone has been set up, and preliminary signal processing code has been written.<\/span><\/p>\n

Plans for Next Week<\/b><\/h6>\n

I will continue to work with Lisa to improve our NLP & database modules, as this is the core part of our system. In addition, I will start installing necessary dependencies on and transferring our code to the microcontroller (RPi 4). <\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Personal Accomplishment In addition to completing the ethics assignment, I integrated our database module and preliminary NLP module with Lisa and modified the microphone & speech recognition system provided by Python\u2019s SpeechRecognition library. After integration, our system is now able to extract menu items and quantities from simple sentences, add them to an Order object, … Continue reading “Nina Duan\u2019s Status Report For 3\/18\/2023”<\/span><\/a><\/p>\n","protected":false},"author":687,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[7],"tags":[],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/wp-json\/wp\/v2\/posts\/160"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/wp-json\/wp\/v2\/users\/687"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/wp-json\/wp\/v2\/comments?post=160"}],"version-history":[{"count":4,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/wp-json\/wp\/v2\/posts\/160\/revisions"}],"predecessor-version":[{"id":166,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/wp-json\/wp\/v2\/posts\/160\/revisions\/166"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/wp-json\/wp\/v2\/media?parent=160"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/wp-json\/wp\/v2\/categories?post=160"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s23-teamd3\/wp-json\/wp\/v2\/tags?post=160"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}