Risks
The biggest risk we are facing is the difference between our current development environment (MacOS) and that of the Raspberry Pi (RPiOS). While our prototype backend flows relatively smoothly on MacOS, it behaves in unexpected ways when migrated to the Raspberry Pi. We are still trying to find the root cause of this. Our fallback is running everything on our laptop instead, which means we might switch to using Arduino. The hardware components therefore would not include a Raspberry Pi. However, this is not a finalized decision. We will continue debugging on our Raspberry Pi this weekend.
Another risk is the overall speech-processing speed. The time it takes for our system to listen to the user input, convert to text, parse into entries, and add to a local order object is longer than our ideal goal of 1 second. Because we are unable to correctly determine the end of speech every time, sometimes the speech recognition module keeps listening after the customer has finished speaking.
Design Changes
We modified our menu to accommodate some NLP edge cases. The current menu is:
cheeseburger $7.99
hamburger $6.99
chicken burger $7.49
beef sandwich $8.99
chicken sandwich $8.99
hot dog $4.99
corn dog $5.99
taco $6.99
donut $3.99
fries $2.99
onion rings $4.99
cheesecake $5.99
fountain drink $1.29
coffee $3.29
ice cream $2.99
We are planning to add three more infrared sensors to increase detection accuracy. We might also use OpenCV as assistance to better detect people with special needs such as children or people sitting in wheelchairs.
Schedule
We have pushed back the design of staff-UI since the integration, testing and revisions will take up all the time before our interim demo. An up-to-date schedule has been attached.
