Omi SDKs

How it works:

Languages Supported:

Docs

Introduction

To update the firmware of your OMI device, you can either:

Update OMI Firmware

As a developer, you can create an app for Omi, letting other people to use your apps and earn.

Prompt-Based Apps

Integration apps allow OMI to interact with external services and process data in real-time. This guide will walk you through creating both Memory Creation Triggers and Real-Time Transcript Processors.

Developing Integration Apps for OMI

Real-Time Audio Streaming

Import Apps

To submit your app to the OMI community, go to [omi mobile app and submit](https://x.com/kodjima33/status/1854725658485965061) there.

Submitting Apps

Follow these steps to get started with your Omi. Don't want to bother with code? Use our official version on / store

App Setup

Welcome to the Omi backend setup guide! Omi is an innovative, multimodal AI assistant that combines cutting-edge technologies to provide a seamless user experience. This guide will help you set up the backend infrastructure that powers Omi's intelligent capabilities.

Backend Setup

Welcome to the Omi backend! This document provides a comprehensive overview of Omi's architecture and code, guiding you through its key components, functionalities, and how it all works together to power a unique and intelligent AI assistant experience.

Backend Deep Dive

This document outlines the process of storing memory objects in the Omi AI system.

Storing Memories

This document outlines the real-time audio transcription process in the Omi application.

Realtime Transcription

This document outlines how Omi creates and stores embeddings for memories.

Memory Embeddings

This document outlines the post-processing workflow for memories in the Omi application.

Memory Post-Processing

Step-by-step guide to compile and install firmware for your OMI device.

Compiling the Device Firmware

Python SDK

React Native SDK

Swift SDK

App-device protocol

We welcome contributions from the community! If you are interested in improving Omi, check out our  (Some of the tasks have paid bounties) To contribute:

Contribution

Storing Audio

Dev Kit 2 Testing

DevKit 1 is a necklace form factor device that can be worn around the neck. It runs on Xiao nRF52840, is powered by a rechargeable battery, and connects to your phone to stream the audio data. The device is designed to be used with the Omi app, which is available on the Apple App Store and Google Play Store.

Omi DevKit 1

DevKit 2 builds on top of and expands the DevKit1 capabilities, while keeping the necklace form factor. It still runs on Xiao nRF52840, but adds 8GB onboard storage, and a speaker, and replaces the on/off switch with a programmable button. This enables the device to listen in standalone mode, although you still need to connect it to the Omi app for processing.

Omi DevKit 2

OpenGlass DevKit is a small clip-on device you can attach to your glasses. It runs on Xiao ESp32S3 Sense platform, and features camera and microphone. The device also has a slot for an SD card, which is currently not utilized.

OpenGlass DevKit

As an open-source community, we empower enthusiasts to create their own OMI devices. This guide focuses on building the **Developer Kit 1**, as the **Developer Kit 2** relies on a custom PCB and is not suited for DIY assembly.

Build Your Own OMI Device

Please note that availability and prices may vary by region.

Part List

Follow this step-by-step guide to build your own OMI device

Building the Device

For open-source support, please open an issue on GitHub and/or ask in our Discord Community. For commercial support, license inquiries, or any other questions, please contact us directly at [team@basedhardware.com](mailto:team@basedhardware.com)

Support

Omi is available under [MIT License](https://github.com/BasedHardware/omi/blob/main/LICENSE)

License

Please note that the Omi is a prototype project and is provided “as is”, without warranty of any kind. Use of the device should comply with all local laws and regulations concerning privacy and data protection.

Disclaimer

At Omi, your privacy and the security of your data are our top priorities. This Privacy Policy is designed to be transparent about how we collect, use, and protect your information.

Get Started

Developer

Hardware

DIY Guide

Info

SDK

Omi SDKs

Languages Supported:

How it works:

Get Started

Developer

Hardware

DIY Guide

Info

​Omi SDKs

​Languages Supported:

​How it works:

Omi SDKs

Languages Supported:

How it works: