ai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework
About the project
Dynamo is an open-source datacenter-scale inference orchestration layer above SGLang, TensorRT-LLM and vLLM that turns a GPU cluster into a coordinated system with disaggregated serving, KV-aware routing and autoscaling.
Useful for
- Deploy multi-node LLM inference with separate prefill and decode pools
- Set up KV-aware routing to cut time to first token
- Search deployment configurations offline with AISimulate without a GPU cluster
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.
Why it’s trending
- 3 stars so far today, about 6 expected by the end of the day.
- GitHub Trending Rust today: #6, +6 stars.
- About 6 forks a day — people are taking the code.
Stars per day
Bars are daily stars, the line is the usual pace. Red marks spike days.
Numbers
- Total stars
- 8,187
- Today
- 3 · ≈ 6 by evening
- Forks
- 1,643
- Issues and pull requests
- 15,285
- Watchers
- 78
- Language
- Rust
- Latest release
- v1.5.0 · September 21, 2026
- Created
- March 3, 2025
- Last push
- September 30, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 30, 2026GitHub Trending Rust today: #6, +6 stars
Share
README badge
Paste it into your README — the badge shows the current magnitude and links to this page.
[](https://gitnova.dev/en/r/ai-dynamo/dynamo)Similar by description
-
1.1
kserve/kserve
KServe is a platform for deploying and serving generative and predictive AI models on Kubernetes, supporting multiple frameworks, autoscaling, and a standardized inference protocol.
-
1.5
kvcache-ai/Mooncake
LLM serving platform built on a KVCache-centric disaggregated architecture: separates prefill and decode and transfers KV cache between nodes over RDMA. Powers Kimi in production at Moonshot AI.
-
2.5
kubernetes/kubernetes
Kubernetes is an open source container orchestration system for deploying, scaling, and managing containerized applications across multiple hosts.