omiGlass DevKit
omiGlass - Open Source Meta Raybans with 6x of their battery
Want a Pre-built Version?
We will ship a limited number of pre-built kits. Get a Dev kit here
Community
Join the Based Hardware Discord for setup questions, contribution guide, and more.
Prerequisites
Before you begin, ensure you have the following installed:
- Ollama for local AI model hosting
- Arduino IDE for firmware upload (if building hardware)
- 3D printer for hardware components (if building your own)
Getting Started
Follow these steps to set up omiglass:
Hardware Components
You’ll need the following components to build your own omiGlass:
- Seeed Studio XIAO ESP32 S3 Sense
- x6 150mah batteries like this or at least like this (but you’ll need to increase the size of the casing)
- 1x 250mah battery like this
- Wires like these and hinges
- Note: The current design does not include a switch. See contribution section for more details.
Software Setup
-
Clone the omiglass repository and install the dependencies:
You can also use yarn to install:
-
Set up your API keys:
-
Copy the
.env.example
file to create a new.env
file: -
Edit the
.env
file and add your API keys:- Get a Groq API key from Groq
- Get an OpenAI API key from OpenAI
- For Ollama, the default URL is already set (http://localhost:11434/api/chat)
-
-
Install the required Ollama model:
-
Start the application:
or with yarn:
Note: This is an Expo project. Open the localhost link (displayed after starting) to access the web version.
Hardware Assembly
-
3D print the glasses mount case using the provided STL files located in the
hardware
folder. -
Assemble the components as shown:
Firmware Installation
-
Open the firmware folder and open the
.ino
file in the Arduino IDE.- If you don’t have the Arduino IDE installed, download and install it from the official website.
- Alternatively, follow the steps in the firmware readme to build using
arduino-cli
-
Set up the Arduino IDE for the XIAO ESP32S3 board:
- Add ESP32 board package to your Arduino IDE:
- Navigate to File > Preferences, and fill “Additional Boards Manager URLs” with:
https://raw.githubusercontent.com/espressif/arduino-esp32/gh-pages/package_esp32_index.json
- Navigate to Tools > Board > Boards Manager…, search for
esp32
, and install the latest version.
- Navigate to File > Preferences, and fill “Additional Boards Manager URLs” with:
- Select your board and port:
- On top of the Arduino IDE, select the port (likely to be COM3 or higher).
- Search for
xiao
in the development board on the left and selectXIAO_ESP32S3
.
- Add ESP32 board package to your Arduino IDE:
-
Configure PSRAM settings:
- Go to the “Tools” dropdown in the Arduino IDE
- Set “PSRAM:” to “OPI PSRAM”
-
Upload the firmware to the XIAO ESP32S3 board.
How You Can Contribute
Software
- Connect glasses with omi app. Currently the glasses only work with web interface
Hardware
- Redesign the legs/sides so that it would fit on bigger heads
- Add a switch into design (current design has no switch, requires manual wire connection)
License
This project is licensed under the MIT License.