Running LLMs locally means privacy, zero API bills, and offline capability. Ranked daily by stars, momentum, and release activity — from one-command runners like Ollama to GGUF inference engines that bring AI back onto your own machine.
Ranking = star magnitude + recent momentum + a release within 90 days + downloadable builds; refreshed daily; 12 apps.
Local AI voice cloning and dubbing tool — VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
80.6k+1.4k/dayGNU Affero General Public License v3.0Local LLMsdebpalash/VoiceStudio
One-click local LLM runner for Qwen models. — Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
Menu bar app to switch AI coding agents between LLM providers. — Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.
Local LLM inference engine in pure C — Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
Local-first AI agent and document chat app. — Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
Local LLM inference engine that auto-tunes kernels for speed. — Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, or just a CPU.
Local LLM inference server for Apple Silicon. — LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Local AI server for running LLMs on your hardware. — Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
