Carnegie Mellon ECE Capstone, Spring 2020: Ashika K, Abha A, Jade T
This week I worked on getting audio latency metrics for our presentation on Monday as well as working on updating our paper and recording segments for our final demo video. On Sunday I realized I had to remeasure system latency because I realized that because …
On Monday I just tested our code before the demo we had and participated in the demo. On Wednesday I wrote testing code to measure speech recognition accuracy. The code pulled random words from the thousand most common English words and then prompted the user …
This week I worked on improving the pi’s main function as well as cleaning up the socket code. Specifically I worked on making it so that the program would close the sockets when done running and also not hang if something happened to a socket …
On Monday I worked on cleaning up the socket interface code. I wrote read and write functions for both the server and the client. On Wednesday I worked on integrating socket code into our program, this consisted of creating a new main file for the …
On Sunday I decided to tackle the choppy audio quality that I was getting from the audio playback. I was using pydub’s AudioSegment to play the sound back, but it was choppy, so, I investigated a few other audio processing packages including pyglet, pygame, tkSpeak, …
On Monday I cleaned up my audio input/output code in order to work with Ashika on integration. I turned my code into easy to call modules, documented it, and documented all the installs needed to run it. I also started writing code that will setup …
This week I worked on getting the simple fill in the blank interface working on the Raspberry Pi. I have the audio input portion working, however have not got the audio output portion working. This is mostly because I have been having trouble figuring out …
During the earlier parts of this week I worked on writing the design report. After the design report was submitted, I talked with Ashika to figure out how the ML algorithm would output dialog to the text to speech portion of KATbot. I then worked …
This week I primarily spent time working on our design presentation. I created a new system diagram for us to use which is displayed below. I also spent a decent amount of time practicing for the presentation. As for what I’ve accomplished regarding the project, …
This week I investigated many different text to speech packages. I evaluated TTS packages on ease of install and use, whether the TTS required internet connection, and the quality of the voice. A lot of the text to speech packages had robotic or choppy voices, …