According to news on May 16, an open source project called "Open Glass AI" recently won first place in the Llama 3 hackathon organized by Meta. According to members of the project,The team only spent $20 (currently about 144 yuan) in material costs to turn any glasses into smart glasses(后续开源项目改为了不到 25 美元)。
As can be seen from the demonstration video of the project members, the "$20" smart glasses consist of a pair of sunglasses and a black box protruding from the right side.The glasses are said to be equipped with a camera that takes a photo every five seconds and a microphone that continuously transcribes audio.. The working principle is to collect a database of photos and text to reflect the information received by the wearer's eyes and ears at the moment.
Functions that can currently be implemented include recording life and taking down people’s names, counting calories, and real-time translation. Press the button on the side of the glasses to access and interact with Meta’s Llama 3 chatbot.
Members of the team also said that this smart glasses can later be connected to OpenAI and even Google Gemini. The most important thing is that it can mix and match a variety of different functional components to create applications and frameworks that users are interested in.
All source code of the project and some demonstration videos are available at Available for free on GitHub. Although the team only spent US$20 in material costs during the competition to complete this project, if they want to reproduce this project, they will need to use the Seeed Studio XIAO ESP32 S3 sensor, EEMB LP502030 3.7v 250mAH battery, and 3D printed Eye support box, etc., the material cost is less than 25 US dollars (currently about 181 yuan).
Source: IT Home