返回排行榜

modular/modular

Mojodocs.modular.com

The Modular Platform (includes MAX & Mojo)

ailanguagemachine-learningmojomodularprogramming-languagemax
Star 增长趋势
Star
26.6k
Forks
2.9k
周增长
Issues
788
10k15k20k25k
2023年5月2024年5月2025年6月2026年7月
README

🤝 Join our monthly community meetings!

Modular Platform

A unified platform for AI development and deployment, including MAX🧑‍🚀 and Mojo🔥.

The Modular Platform is an open and fully-integrated suite of AI libraries and tools that accelerates model serving and scales GenAI deployments. It abstracts away hardware complexity so you can run the most popular open models with industry-leading GPU and CPU performance without any code changes.

Get started

You don't need to clone this repo.

You can install Modular using a pip or conda package manager like uv or pixi and then start an OpenAI-compatible endpoint with a model of your choice.

To get started with the Modular Platform and serve a model using the MAX framework, see the quickstart guide.

[!NOTE] Nightly vs. stable releases If you cloned the repo and want a stable release, run git checkout max/vX.X to match the version.

The main branch tracks nightly builds.

For more information, see Branches.

After your model endpoint is up and running, you can start sending the model inference requests using our OpenAI-compatible REST API.

Explore all the models you can deploy with Modular in our Model Library.

Deploy our container

The MAX container is our Kubernetes-compatible Docker container for convenient deployment, which uses the MAX framework's built-in inference server. We have separate containers for NVIDIA and AMD GPU environments, and a unified container that works with both.

For example, you can start a container for an NVIDIA GPU with this command:

docker run --gpus=1 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    -p 8000:8000 \
    modular/max-nvidia-full:latest \
    --model google/gemma-3-27b-it

For more information, see our MAX container docs or the Modular Docker Hub repository.

Get started with Mojo

You don't need to clone this repo to get started with Mojo.

To install Mojo and get started learning the language, see the Mojo quickstart. The Mojo site also features a comprehensive language guide with tutorials, a language reference, and API references.

About the repo

We're constantly open-sourcing more of the Modular Platform and you can find all of it in here. As of May, 2025, this repo includes over 450,000 lines of code from over 6000 contributors, providing developers with production-grade reference implementations and tools to extend the Modular Platform with new algorithms, operations, and hardware targets.

It's quite likely the world's largest repository of open source CPU and GPU kernels!

Highlights include:

Branches

  • The main branch is in sync with the nightly build and subject to new bugs. Use this branch for contributions.

  • MAX release branches are named max/vX.X.

  • Mojo release branches are named mojo/vX.X.X (Mojo uses the PEP 440 version scheme).

  • For stable releases prior to MAX 26.3 / Mojo 1.0.0b1, combined MAX/Mojo release branches are named modular/vX.X.

Contribute

We accept contributions to the Mojo standard library, MAX AI kernels, MAX model architectures, code examples, Mojo docs, and more.

First, please read the Contribution Guide, and then refer to the following documentation about how to develop in the repo:

  • /max/docs: Docs for developers working in the MAX framework codebase.
  • /mojo/stdlib/docs: Docs for developers working in the Mojo standard library.

We also welcome your bug reports. If you have a bug, please file an issue here.

News & Announcements

[2026/3] Modular Platform 26.2 delivers state-of-the-art image generation with over 4x speedup on FLUX.2 models, expanded hardware support for NVIDIA B300, Jetson Thor, DGX Spark, and AMD RDNA consumer GPUs, and Mojo language upgrades that make it easier to write GPU kernels with AI coding agents.

[2026/2] We announced that BentoML is joining Modular. We are committed to building in the open and will be extending our support of open source AI with Bento's own open project. Read the answers in our February 2026 AMA to learn more about our plans.

[2026/1] Modular Platform 26.1 graduates the MAX Python API out of experimental with PyTorch-like eager mode and model.compile() for production, stabilizes the MAX LLM Book, and expands Apple silicon GPU support. Mojo gains compile-time reflection, linear types, typed errors, and improved error messages as it progresses toward 1.0.

[2025/12] The Path to Mojo 1.0 was officially announced with a planned release in H1 2026 and tons of details on what to expect.

[2025/12] We hosted our Inside the MAX Framework Meetup reintroducing the MAX framework and taking the community through upcoming changes.

[2025/11] Modular Platform 25.7 provides a fully open MAX Python API, expanded hardware support for NVIDIA Grace superchips, improved Mojo GPU programming experience, and much more.

[2025/11] We met with the community at PyTorch 2025 + the LLVM Developers' Meeting to solicit community input into how the Modular platform can reduce fragmentation and provide a unified AI stack.

[2025/09] Modular raises $250M to scale AI's unified compute layer, bringing Modular's total raise to $380M at a $1.6B valuation.

[2025/09] Modular Platform 25.6 delivers a unified compute layer spanning from laptops to datacenter GPUs, with industry-leading throughput on NVIDIA Blackwell (B200) and AMD MI355X.

[2025/08] Modular Platform 25.5 introduces Large Scale Batch Inference through a partnership with SF Compute + open source launch of the MAX Graph API and more.

[2025/08] We hosted our Los Altos Meetup featuring talks from Chris Lattner on democratizing AI compute and Inworld AI on production voice AI.

[2025/06] AMD partnership announced — Modular Platform now generally available across AMD's MI300 and MI325 GPU portfolio.

[2025/06] Modular Hack Weekend brought developers together to build custom kernels, model architectures, and PyTorch custom ops with Mojo and MAX.

[2025/05] Over 100 engineers gathered at AGI House for our first GPU Kernel Hackathon, featuring talks from Modular and Anthropic engineers.


Community & Events

We host regular meetups digitally and around the world. During these meetups we share updates from the Modular team, feature community contributions, and invite guest speakers to share their expertise, as well as answer community questions.

Join us!

Channel Link
💬 Discord discord.gg/modular
💬 Forum forum.modular.com
📅 Meetup Group meetup.com/modular-meetup-group
🎥 Community Meetings Upcoming community calls

Upcoming events will be posted on our Meetup page and Discord. Community meeting recordings will be posted on our YouTube.

Contact us

If you'd like to chat with the team and other community members, please send a message to our Discord channel and our forum board.

License

This repository and its contributions are licensed under the Apache License v2.0 with LLVM Exceptions (see the LLVM License). Modular, MAX and Mojo usage and distribution are licensed under the Modular Community License.

Third party licenses

You are entirely responsible for checking and validating the licenses of third parties (i.e. Huggingface) for related software and libraries that are downloaded.

Thanks to our contributors

相关仓库
openclaw/openclaw

Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞

TypeScriptnpmOtheraiassistant
openclaw.ai
383.6k80.6k
obra/superpowers

An agentic skills framework & software development methodology that works.

ShellMIT Licenseaibrainstorming
258.3k23k
NousResearch/hermes-agent

The agent that grows with you

PythonPyPIMIT Licenseaiai-agent
hermes-agent.nousresearch.com
217.9k41.1k
n8n-io/n8n

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

TypeScriptnpmOtherautomationipaas
n8n.io
197.2k59.5k
Significant-Gravitas/AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

PythonPyPIOtheraiopenai
agpt.co
185.6k46.1k
f/prompts.chat

f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.

HTMLOtherchatgptai
prompts.chat
166.1k21.5k
AUTOMATIC1111/stable-diffusion-webui

Stable Diffusion web UI

PythonPyPIGNU Affero General Public License v3.0deep-learningdiffusion
164.3k30.4k
Snailclimb/JavaGuide

Java 面试 & 后端通用面试指南,覆盖计算机基础、数据库、分布式、高并发、系统设计与 AI 应用开发

JavaScriptnpmApache License 2.0javainterview
javaguide.cn
157.2k46.2k
firecrawl/firecrawl

The API to search, scrape, and interact with the web at scale. 🔥

TypeScriptnpmGNU Affero General Public License v3.0aicrawler
firecrawl.dev
153.6k8.8k
langgenius/dify

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

TypeScriptnpmOtheraigpt
dify.ai
149.5k23.6k
open-webui/open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

PythonPyPIOtherollamaollama-webui
openwebui.com
146.1k21.2k
langchain-ai/langchain

The agent engineering platform.

PythonPyPIMIT Licenseaianthropic
docs.langchain.com/langchain/
142.2k23.6k