Main Accomplishments for This Week
- Mobile App
- MediaPipe hand landmark detection
- CoreML initiated
- ML learning
- Translation algorithms optimization
- LLM initialization
- Hardware
- All wires soldered
- Bluetooth connected
- OLED screen display enabled
Risks & Risk Management
- Since MediaPipe does not provide a pose detection model for iOS, not including pose landmarks might reduce the accuracy. Accordingly, we will seek possible solutions. But if no reliable complementary pose detection model is available, we would adjust our ML model to focus on prediction based on hand landmarks.
Design Changes
- We decided to use LLM instead of NLP to structure sentences. Since OpenAI provides handy interface, an LLM model does not need complicated training and it provides more accurate result.
Schedule Changes
- We may need an extra week to reach the final sentence translation milestone and the mobile app launch milestone. With staged progress, our overall system integration and final testing, verification and validation are expected to be finished in the last week. Accordingly, we have updated our schedule.
