StarRank
순위급상승AIAI 스택AI 토픽맵
Models & ML

LLM Serving

479 개 결과
1ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.GoGo Modulesllamallm184.2k2ggml-org/llama.cppLLM inference in C/C++C++libraryggml132k3vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMsPythonlibraryPyPIgptllm94.9k4diegosouzapw/OmniRouteNever stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop…TypeScriptnpma2aai-agents79k5nomic-ai/gpt4allGPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.C++appllm-inferenceai-chat77.4k6xtekky/gpt4freeThe official gpt4free repository | various collection of powerful language models | opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3PythonlibraryPyPIchatgptchatgpt-466.9k7BerriAI/litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]PythonlibraryPyPIanthropiclangchain61.8k8meta-llama/llamaInference code for Llama modelsPythonlibraryPyPIllamainference59.6k9zylon-ai/private-gptComplete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.PythonlibraryPyPIaiai-tools57.6k10router-for-me/CLIProxyAPIWrap Antigravity, ChatGPT Codex, Claude Code, Grok Build, Muse Code, Devin as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini Series, GPT Series, Grok Series, Claude model through APIGoGo Modulesclaude-codecluade55.9k11xai-org/grok-1Grok open releasePythonlibraryPyPIllmjax52.2k12QuantumNous/new-apiA unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management.GoGo Modulesclaudegemini50.4k13mudler/LocalAILocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.GoGo Modulesllamaai49.8k14exo-explore/exoRun frontier AI locally.PythonPyPIllminference48k15oobabooga/textgenOpen-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.PythonappPyPIllmdesktop47.7k16janhq/janJan is an open source alternative to ChatGPT that runs 100% offline on your computer.Rustappcrates.iollamacpplocalai45k17chatanywhere/GPT_API_free免费大模型API，支持免费调用GPT、DeepSeek等主流模型，免费额度10000点，每日刷新！另付费价格最低官方1-2折！apichatgpt44.6k18Wei-Shaw/sub2apiSub2API 一站式开源中转服务，让 Claude、Openai 、Gemini、Grok订阅统一接入，支持拼车共享，更高效分摊成本，原生工具无缝使用。GoGo Modules2apiantigravity2api44.6k19JustVugg/colibriRun frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦Cclillm-inferencemoe43.2k20microsoft/BitNetOfficial inference framework for 1-bit LLMsC++libraryllm-inference1-bit41.2k21lyogavin/airllmAirLLM 2.8T LLM inference with single 4GB GPUJupyter Notebooklibrarychinese-nlpfinetune40.2k22lm-sys/FastChatAn open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.PythonPyPIllmchatbot39.5k23tashfeenahmed/freellmapi7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.TypeScriptnpmllmapi-gateway39k24AlexsJones/llmfitHundreds of models & providers. One command to find what runs on your hardware.Rustclicrates.iollmskill38.2k
전체 479개 중 1–24
12345