The social information of people defines people’s identities, behaviors and interactions. The technological progress of social network enables people to expand their connections to the order of thousands. Almost everyone’s social and identity information can be found online. However, it is difficult for people to remember all their connections’ social information in either social settings or identification. To aid people’s daily social interaction and identification, we plan to design and build an augmented reality (AR) based social information display. The display device combines an Android smartphone and a Holokit, an AR cardboard headset. The device identify people using facial recognition algorithm, and render an AR display of people’s names and other social information fetched through Facebook API in the user’s field of view. The current goal is to limit facial recognition and AR rendering latency less than 0.5 second, able to recognize 30 people with an accuracy of over 95%.
The diagram below outlines our high-level architecture.