AI that sees your screen, listens to your conversations and tells you what to do
omi
A 2nd brain you trust more than your 1st
Omi captures your screen and conversations, transcribes in real-time, generates summaries and action items, and gives you an AI chat that remembers everything you've seen and heard. Works on desktop, phone and wearables. Fully open source.
Trusted by 300,000+ professionals.
Quick Start
macOS
git clone https://github.com/BasedHardware/omi.git && cd omi/desktop/macos && ./run.sh --yolo
Builds the macOS app, connects to the cloud backend, and launches. No env files, no credentials, no local backend.
Requirements: macOS 14+, Xcode (includes Swift & code signing), Node.js
Windows
git clone https://github.com/BasedHardware/omi.git
cd omi\desktop\windows
npm install
copy .env.example .env
npm run dev
Starts the Windows desktop app from source using the public config in .env.example.
Requirements: Node.js
For development worktrees, run the cheap local setup once:
make setup
Full Installation
For local development with the full backend stack:
- Install prerequisites
xcode-select --install
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
- Clone and configure
git clone https://github.com/BasedHardware/omi.git
cd omi/desktop/macos
cp Backend-Rust/.env.example Backend-Rust/.env
- Build and run
./run.sh
See desktop/macos/README.md for environment variables and credential setup.
Mobile App
cd app && bash setup.sh ios # or: bash setup.sh android
How it works
┌─────────────────────────────────────────────────────────┐
│ Your Devices │
│ │
│ ┌──────────┐ ┌──────────────┐ ┌───────────────────┐ │
│ │ Omi │ │ macOS App │ │ Mobile App │ │
│ │ Wearable │ │ (Swift/Rust) │ │ (Flutter) │ │
│ └────┬─────┘ └──────┬───────┘ └────────┬──────────┘ │
│ │ BLE │ HTTPS/WS │ │
└───────┼────────────────┼───────────────────┼─────────────┘
│ │ │
▼ ▼ ▼
┌─────────────────────────────────────────────────────────┐
│ Omi Backend (Python) │
│ │
│ ┌─────────┐ ┌──────────┐ ┌─────────┐ ┌──────────┐ │
│ │ Listen │ │ Pusher │ │ VAD │ │ Diarizer │ │
│ │ (REST) │ │ (WS) │ │ (GPU) │ │ (GPU) │ │
│ └─────────┘ └──────────┘ └─────────┘ └──────────┘ │
│ │
│ ┌─────────┐ ┌──────────┐ ┌─────────┐ ┌──────────┐ │
│ │ Deepgram│ │ Firestore│ │ Redis │ │ LLMs │ │
│ │ (STT) │ │ (DB) │ │ (Cache) │ │ (AI) │ │
│ └─────────┘ └──────────┘ └─────────┘ └──────────┘ │
└─────────────────────────────────────────────────────────┘
| Component | Path | Stack |
|---|---|---|
| macOS app | desktop/macos/ |
Swift, SwiftUI, Rust backend |
| Mobile app | app/ |
Flutter (iOS & Android) |
| Backend API | backend/ |
Python, FastAPI, Firebase |
| Firmware | omi/ |
nRF, Zephyr, C |
| Omi Glass | omiGlass/ |
ESP32-S3, C |
| SDKs | sdks/ |
React Native, Swift, Python |
| AI Personas | web/personas-open-source/ |
Next.js |
Documentation
Getting Started
- Introduction
- Quick Start Guide
- macOS App Development
- Mobile App Setup
- Backend Setup
- Contributing — also
CONTRIBUTING.mdandPRODUCT.md
Building Apps
- App Development Guide
- Example Apps — GitHub, Slack, OmiMentor
- Audio Streaming Apps
- Custom Chat Tools
- Submit to App Store
API & SDKs
- API Reference — REST endpoints for memories, conversations, action items
- Python SDK
- Swift SDK
- React Native SDK
- MCP Server — Model Context Protocol integration
Architecture
Omi Hardware
Open-source AI wearables that pair with the mobile app for 24h+ continuous capture.
- Buy Omi
- Buy Omi Glass Dev Kit — ESP32-S3, camera + audio
- Open Source Hardware Designs
- Buying Guide
- Build the Device
- Flash Firmware
- Integrate Your Wearable
- Hardware Specs
License
MIT — see LICENSE