OmniVoice Studio

The open-source ElevenLabs alternative.

Real-time dictation, zero-shot voice cloning, and cinematic video dubbing — all on your desktop.
No accounts. No API keys. No cloud. Everything runs on your machine. Open-source, 646 languages.

Quickstart · Features · vs Others · Engines · API · Donate · Contributing · Discord · 简体中文

Your voice is the most personal data you have. So why rent it back from a cloud? Every mainstream voice tool ships your audio to someone else's server and bills you monthly for the privilege. OmniVoice Studio flips that: clone, design, dub, and dictate on your own hardware — 646 languages, no meter running, nothing leaving your machine.

[!WARNING] Active beta. Things may break between releases — for the newest fixes, run from source. Bug reports and PRs are very welcome: open an issue or join Discord.

📸 See it in action

Studio Generate & clone in one workspace — a 3-second clip mirrors any voice, 646 languages, zero-shot.	Voice Design Build new voices from scratch — gender, age, accent, pitch, emotion, dialect.
Voice Gallery Browse ready-made archetype voices with language filters, or build your own — then pick any of them in Studio, Audiobook, Stories, and Dubbing.	Video Dubbing A real dub, end to end: 37 segments transcribed, translated to Bengali, re-voiced, and timed — ready to export as MP4.
Settings → Engines The engine compatibility matrix — 14 TTS engines with per-engine GPU preflight, no silent CPU fallback.	Settings → Models One-click model store — auto-detects your platform (CUDA / MPS / CPU) and recommends the right models.

✨ Features

Three flagships, five more headliners, and a dozen under the fold.

🎙️ Voice Cloning 3-sec clip → any voice · 646 languages · zero-shot	🎨 Voice Design Describe it — gender, age, accent, emotion	🎬 Video Dubbing Transcribe → translate → re-voice → MP4

⚡ Quickstart

_{macOS: first launch needs a one-time approval — right-click → Open (or System Settings → Privacy & Security → "Open Anyway" on macOS 15). No Terminal needed. Why? · Intel Macs: local backend unsupported (#889) — details.}

Install guide: 🍎 macOS · 🪟 Windows · 🐧 Linux · 🐳 Docker

⚖️ vs Others

ElevenLabs charges $5–$330/mo and processes your audio on their servers. OmniVoice Studio runs on your hardware, with no usage limits.

Professional-grade voice AI, minus the subscription and the cloud.

Convinced? Come build with us.

🖥️ System Requirements

[!NOTE] A GPU is optional — the whole pipeline runs on CPU (just slower), and on ≤8 GB VRAM, TTS auto-offloads to CPU. Caveats: AMD ROCm is Linux-only + opt-in (Linux) — Windows AMD/Ryzen AI is CPU-only (Windows); macOS Intel can't run the local backend, so point it at a remote one (#889 · macOS).

🗣️ TTS Engines

14 engines, one picker. OmniVoice (default, 600+ languages) is always available; seven more are opt-in and auto-detected (CosyVoice 3, GPT-SoVITS, VoxCPM2, MOSS-TTS-Nano, KittenTTS, MLX-Audio, Sherpa-ONNX), plus six lazy-installed heavyweights (IndexTTS 2, OmniVoice GGUF, Supertonic 3, MOSS-TTS-v1.5, dots.tts, Confucius4-TTS). Switch in Settings → TTS Engine; the choice applies everywhere synthesis happens.

🎧 ASR Engines

11 engines — they power dictation, video dubbing, and subtitles. WhisperX is the cross-platform default (~100 languages, word-level timing); the rest are opt-in and auto-detected. Switch in Settings → Engines. Ten run fully on-device; the eleventh (OpenAI-compatible) is an optional remote client for Qwen3-ASR or any compatible server.

🏗️ Architecture

A Tauri v2 desktop shell (Rust) wraps a React UI and a bundled Python/FastAPI backend that runs as a local sidecar on localhost:3900. Nothing external — every layer is on your machine.

┌────────────────────────────────────────────────────────────────────┐
│  Tauri v2 shell — Rust                                             │
│  window state · global dictation hotkey · system tray ·           │
│  signed auto-updater (stable/preview) · single-instance ·         │
│  first-run bootstrap (installs uv + Python venv) · blank guard    │
├────────────────────────────────────────────────────────────────────┤
│  Frontend — React + Vite                                          │
│  Studio · Dub · Stories · Audiobook · Gallery · Dictation ·       │
│  Batch · Diagnostics · MCP client    —   Zustand store · WS bus   │
│                          ▲  IPC  /  HTTP + WS                      │
├──────────────────────────┼─────────────────────────────────────────┤
│  Backend — FastAPI sidecar @ localhost:3900                       │
│  100+ REST endpoints · SSE + WebSocket streaming ·               │
│  SQLite + Alembic (omnivoice_data/) · OpenAI-compatible API       │
├───────────┬───────────┬───────────┬───────────┬────────────────────┤
│  TTS ×14  │  ASR ×11  │  Demucs   │ Pyannote  │  AudioSeal         │
│  clone /  │  WhisperX │  vocal    │  speaker  │  watermark         │
│  design   │  +10 more │  isolation│  diariz.  │  embed / detect    │
├───────────┴───────────┴───────────┴───────────┴────────────────────┤
│  Engine routing — per-engine GPU preflight, no silent CPU fallback │
│  Hardware:  CUDA · MPS · ROCm (Linux) · CPU   (auto-detected)      │
└────────────────────────────────────────────────────────────────────┘

• Shell (Rust) — native OS integration: the system-wide dictation hotkey, tray, signed auto-updater (stable + preview channels), single-instance lock, and the first-run bootstrap that installs uv and a Python 3.11 venv.
• Frontend (React) — every workspace tab over a Zustand store, with a WebSocket event bus that live-refreshes the UI when backend data changes.
• Backend (FastAPI) — the bundled Python sidecar: 100+ endpoints, SSE/WSS streaming, a SQLite DB migrated by Alembic, and the OpenAI-compatible API surface.
• Engines — 14 TTS + 11 ASR, plus Demucs (isolation), Pyannote (diarization), and AudioSeal (watermark), all behind routing that GPU-preflights each engine and refuses to silently fall back to CPU.

🔌 OpenAI-compatible API

- base_url="https://api.openai.com/v1"
+ base_url="http://localhost:3900/v1"

Your existing scripts, agents, and OpenAI/ElevenLabs SDK calls now run locally on whatever engine you have active. What the cloud can't do: voice takes your own cloned-voice profile IDs, and model can pin a specific engine per request.

Speak with your own cloned voice — list the IDs, then pass one as voice:

# 1 — find a cloned voice's profile ID
curl -s http://localhost:3900/v1/audio/voices | jq '.voices[] | select(.type=="profile") | {voice_id, name}'

# 2 — synthesize with it
curl http://localhost:3900/v1/audio/speech \
  -H "Content-Type: application/json" \
  -d '{"model":"tts-1","voice":"<profile-id>","input":"Made on my own hardware.","response_format":"wav"}' \
  --output speech.wav

from openai import OpenAI
client = OpenAI(base_url="http://localhost:3900/v1", api_key="none")  # any string — nothing checks it

# TTS with your cloned voice (or "alloy" / "default"; model= can pin a specific engine)
with client.audio.speech.with_streaming_response.create(
        model="tts-1", voice="<profile-id>", input="Made on my own hardware.") as r:
    r.stream_to_file("speech.wav")

# STT
print(client.audio.transcriptions.create(model="whisper-1", file=open("clip.wav", "rb")).text)

Want the whole surface (100+ endpoints)? The full REST API reference is embedded in the app — Settings → OpenAPI Reference (Scalar-powered), or the {} button in the footer.

Calling the backend from another machine (LAN, Tailscale, behind a proxy)? It's loopback-only and unauthenticated by default; to reach it remotely you set a share PIN or an API key. docs/api-auth.md covers the exact headers, query params, 401/403/429 meanings, and the OMNIVOICE_TRUSTED_NETWORKS exemption.

📓 Run on Google Colab

No local GPU? The official notebook boots the full app — web UI included — on a free Colab T4, then walks the whole feature surface (TTS, cloning, design, transcription, dubbing, audiobook, watermarking, the OpenAI-compatible API) as a guided tour with inline playback. No tunnels, no API keys.

🤝 Agent Skills

Teach your coding agent to speak and listen through your local OmniVoice — one command, works with Claude Code, Codex, Cursor, Grok, Kimi, opencode, and any skills.sh-compatible agent:

npx skills add debpalash/omnivoice-studio

Ships two skills:

• omnivoice — generate speech (including your cloned voices) and transcribe audio from any agent, free and fully offline via your local install.
• oss-maintainer — the maintainer methodology this project is run with, for anyone running their own OSS project with an agent.

🗺️ Roadmap

🔜 Up Next

• 🎬 Lip-sync v2 — visual speech timing with wav2lip
• 🌐 Hosted Demo — try OmniVoice without installing anything
• 🔌 Plugin Marketplace — community-contributed TTS engines and effects
• 🎵 Real-time Voice Changer — live microphone transformation during calls

💜 Sponsor / Donate

One developer, real AI-agent bills. If OmniVoice is useful to you, chipping in keeps development full-time — every dollar goes straight to the bills.

  

_{Also from the maker: Opal 💠 · memxt 🧠 — a ⭐ helps too.}

🌟 Sponsors

OmniVoice is free and AGPL-3.0 — no paid tier, no SaaS revenue. Sponsors keep development going, and in return get a logo slot here, in the app, and (for top tiers) on the project website. It's a thank-you, never a paywall. See tiers & become a sponsor →

_{💡 GitHub also shows a Sponsor button at the top of this repo, wired to the same links via .github/FUNDING.yml.}

💬 Community

_{We respond to setup questions within hours, not days.}

🤝 Contributing

Yes please — bug fixes, new TTS engine adapters, UI improvements, docs, translations. All of it.

• 📖 Read the Contributing Guide for setup, code style, and PR workflow
• 🐛 Browse good first issues
• 💬 Join our Discord to discuss ideas or ask for help

❓ FAQ

📜 License

OmniVoice Studio is free and open-source software under the GNU Affero General Public License v3.0 (AGPL-3.0).

Free for any use — including commercial and internal business use. Run it, sell the audio you produce with it, dub your own or clients' videos, roll it out across your team — all free, no license needed. As a network copyleft license, AGPL adds one obligation: if you modify OmniVoice Studio and offer that modified version to others over a network, you must make the complete corresponding source of your modified version available to them under the same AGPL-3.0 terms.

A commercial license is available for organizations that want to embed OmniVoice Studio in a closed-source or proprietary product or service without the AGPL-3.0 copyleft obligations. Pricing tiers coming soon. Inquiries: OmniVoice@palash.dev.

The bundled omnivoice/ TTS model by Han Zhu remains Apache-2.0 upstream. See LICENSE for the full, binding terms, and LICENSE-NOTICE.md for the plain-language summary and scope.

🙏 Acknowledgments

OmniVoice Studio is built on the shoulders of exceptional open-source work:

🧰 More local open-source from the maker

Like the local-first philosophy? It runs in the family — same maker, same rule: your data stays on your machine.

Opal 💠 Play everything. The media player for the AI era. Video, anime, comics, torrents, Jellyfin & Plex — one player for all of it, with local AI memory and context built in. Written in Zig, runs on macOS & Windows.

memxt 🧠 The fastest benchmarked open-source AI memory system. Local long-term memory for Claude Code and coding agents — an MCP server on SQLite + embeddings, 100% on your machine. Your agent finally remembers yesterday.

If you read this far, you're our kind of person.
⭐ Star this repo so others can find it too.
💬 Join the Discord to share what you build.
❤️ Support development — fund the AI agent bills that keep OmniVoice shipping.