Project
- Stars
- Started
- Issues
- License
Use a glasses assistant with memory and background tasks
Hawky connects an iPhone to your Ray-Ban Meta glasses through Meta's Device Access Toolkit. It sends chosen camera frames and audio to a realtime AI model. A gateway you can host keeps text memories and runs longer tasks after the conversation ends.
You build the iPhone app in Xcode 26 and run the gateway with Bun 1.3 or later. You also need the Meta AI app, Developer Mode and your own model credentials. Full audio and video recording and searchable visual memory are unfinished.
How did it go? Tips, problems, questions…
Use a glasses assistant with memory and background tasks
Hawky connects an iPhone to your Ray-Ban Meta glasses through Meta's Device Access Toolkit. It sends chosen camera frames and audio to a realtime AI model. A gateway you can host keeps text memories and runs longer tasks after the conversation ends.
You build the iPhone app in Xcode 26 and run the gateway with Bun 1.3 or later. You also need the Meta AI app, Developer Mode and your own model credentials. Full audio and video recording and searchable visual memory are unfinished.
Hao AI Lab and 5 others
550 followers · joined Oct 2023
Feedback
How did it go? Tips, problems, questions…