Models & ML
LLM Serving
479 resultados1ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.GoGo Modulesllamallm+132 ★/día184.2k18.5k2ggml-org/llama.cppLLM inference in C/C++C++libraryggml+93 ★/día132k24.7k3vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMsPythonlibraryPyPIgptllm+447 ★/día94.9k23.8k4diegosouzapw/OmniRouteNever stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop…TypeScriptnpma2aai-agents79k11.5k5nomic-ai/gpt4allGPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.C++appllm-inferenceai-chat+2 ★/día77.4k8.3k6xtekky/gpt4freeThe official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3PythonlibraryPyPIchatgptchatgpt-4+5 ★/día66.9k13.5k7BerriAI/litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]PythonlibraryPyPIanthropiclangchain+79 ★/día61.8k12.6k8meta-llama/llamaInference code for Llama modelsPythonlibraryPyPIllamainference59.6k9.8k9zylon-ai/private-gptComplete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.PythonlibraryPyPIaiai-tools+3 ★/día57.6k7.6k10router-for-me/CLIProxyAPIWrap Antigravity, ChatGPT Codex, Claude Code, Grok Build, Muse Code, Devin as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini Series, GPT Series, Grok Series, Claude model through APIGoGo Modulesclaude-codecluade+91 ★/día55.9k8.5k11xai-org/grok-1Grok open releasePythonlibraryPyPIllmjax52.2k8.5k12QuantumNous/new-apiA unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management.GoGo Modulesclaudegemini+76 ★/día50.4k12.2k13mudler/LocalAILocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.GoGo Modulesllamaai+41 ★/día49.8k4.5k14exo-explore/exoRun frontier AI locally.PythonPyPIllminference+25 ★/día48k3.6k15oobabooga/textgenOpen-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.PythonappPyPIllmdesktop47.7k6k16janhq/janJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Rustappcrates.iollamacpplocalai+14 ★/día45k3.1k17chatanywhere/GPT_API_free免费大模型API,支持免费调用GPT、DeepSeek等主流模型,免费额度10000点,每日刷新!另付费价格最低官方1-2折!apichatgpt+58 ★/día44.6k2.7k18Wei-Shaw/sub2apiSub2API 一站式开源中转服务,让 Claude、Openai 、Gemini、Grok订阅统一接入,支持拼车共享,更高效分摊成本,原生工具无缝使用。GoGo Modules2apiantigravity2api+85 ★/día44.6k9.6k19JustVugg/colibriRun frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦Cclillm-inferencemoe+169 ★/día43.2k4.9k20microsoft/BitNetOfficial inference framework for 1-bit LLMsC++libraryllm-inference1-bit+4 ★/día41.2k3.8k21lyogavin/airllmAirLLM 2.8T LLM inference with single 4GB GPUJupyter Notebooklibrarychinese-nlpfinetune+233 ★/día40.2k4.1k22lm-sys/FastChatAn open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.PythonPyPIllmchatbot+1 ★/día39.5k4.8k23tashfeenahmed/freellmapi7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.TypeScriptnpmllmapi-gateway+632 ★/día39k5.3k24AlexsJones/llmfitHundreds of models & providers. One command to find what runs on your hardware.Rustclicrates.iollmskill+29 ★/día38.2k2.5k