最佳开源本地推理应用

本地AI语音克隆和配音工具 — VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.

本地一键运行 Qwen 大模型 — Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

多模型网关切换工具 — Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.

在本地下载并运行开源大模型 — Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

↔ 开源替代 LM Studio

本地运行大模型推理引擎 — Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

自托管AI聊天界面，支持Ollama — User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

本地 AI 助手与文档问答工具 — Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

↔ 开源替代 ChatGPT

本地离线运行大模型聊天应用 — Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

↔ 开源替代 ChatGPT

自动调优内核的本地大模型推理引擎 — Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, or just a CPU.

↔ 开源替代 Ollama

苹果芯片本地大模型服务 — LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

↔ 开源替代 Ollama

本地大模型切换工具 — Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

本地大模型推理服务器 — Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

↔ 开源替代 Ollama