Trained 4 models, male/female positive/negative emotion classification models and male/female multi-emotion classification models multi-emotion classification models perform poorly, so will be using binary classification instead Combined text and tone analysis Moved nets to cloud (but still need to work on getting it hooked up with the web app) Web app Read more…
Training the voice tone analyzer Keep working on: Integrating the team’s parts together! Put everything on Github to share with team members Put everything on cloud
Additions to webapp, video streaming Reevaluated problem statement and goal through ethics assignment More tests with example voice tone analyzer using CNNs To Do: Journal recording storage on cloud Fix display bug for videos More Voice Tone Training
Changed the program I’m using to get pitch and other features; no longer using Praat because it takes too long and is inefficient; using the python Librosa library instead (documentation here https://librosa.github.io/librosa/) Testing out example voice tone analyzer using CNNs; one project claims to have reached 70% accuracy Next week: Prepare Read more…
This week was focused on gathering data, picking algorithms, and preprocessing/getting features of data Next week will be finishing gathering important features from data and starting to train. SOW and Gantt Chart: The original web application was going to communicate with the RPi and receive textual journal entries of Read more…
This week was mainly focused on planning how to move forward with our project, what to keep and what to change. More details about this can be found below in my statement of work, but the main part is that I will have a new task in the project, speech Read more…
This week I worked on the UI of the web application. Updated look here: I also added the six emotion categories (sad, happy, angry, neutral, surprise, disgust) properly into the database; emotion categories can now be linked to entries. More things I need to do is to make the numbers Read more…
This week I worked on the design presentation and the web app; working on the presentation helped me plan out the web app more concretely; for example the models and url paths, included in the presentation and also added here: My goal for this coming week is to finish implementing Read more…
This week I worked on the web application for our project. I set up the application using Django, and set up the database using mySQL. The two objects we have right now are emotion and entry; “emotion” will be used to categorize the emotions of the journal entries as well Read more…
This week I worked on the block diagrams for the Design Review presentation including the interactions between the servers and E-MO, the IoT devices and E-MO, and the url routing diagrams between the trained neural nets, the web application, and E-MO. (The main block digram for the server and E-MO Read more…