I spent most of this week working on researching system architecture and design. I determined that the maximum number of characters we can fit within one line on the goggles is 12 characters with 12px font. We believe that we can fit both a GPS HUD with 12px font on the top of the display, and also 2 lines for translation–also 12px font–in the middle of the display.
I created diagrams for this pixel outline and determined the appropriate padding and spacing needed to make the goggle text readable and undistorted. With that said, we may change this design to have higher px font size depending on our tests with the goggles. Along with this, I also created diagrams illustrating the examples of using the goggles, as well as an overall hardware diagram, connecting all components appropriately and specifying certain communication protocols.
Lastly, I spent a lot of time determining the open source models we would use for both character detection and translation. I researched the computation time of these models, as well as the latency of RGB image transfer over wifi, to determine the best allocation of computation within our different subsystems. Overall, I feel like we are on track in terms of scheduling. I am hoping that our hardware comes soon.
I was not successful in completing a CAD model of the hardware housing, but honestly this is really difficult without having the physical goggles on hand. We may have to print our own goggles or goggle extensions depending on how deep the goggles are and how well the beamsplitter fits within the goggles. I plan on working on this CAD housing, testing and assembling any incoming hardware, and further researching and testing open source OCR models in the coming week.