# ai-dynamo/dynamo

> Dynamo is an open-source datacenter-scale inference orchestration layer above SGLang, TensorRT-LLM and vLLM that turns a GPU cluster into a coordinated system with disaggregated serving, KV-aware routing and autoscaling.

- Magnitude: 1.6 out of 10 — Steady
- Stars: 8,188 total · +4 stars today, ≈ 7 by evening
- Star trust: star growth looks organic
- Category: DevOps & infrastructure · Language: Rust · Created: 2025-03-03 · Last push: 2026-09-30
- GitHub: https://github.com/ai-dynamo/dynamo · Homepage: https://docs.nvidia.com/dynamo/latest · Page: https://gitnova.dev/en/r/ai-dynamo/dynamo

## Useful for

- Deploy multi-node LLM inference with separate prefill and decode pools
- Set up KV-aware routing to cut time to first token
- Search deployment configurations offline with AISimulate without a GPU cluster

## Why it’s here

- 4 stars so far today, about 7 expected by the end of the day.
- GitHub Trending Rust today: #6, +6 stars.
- About 6 forks a day — people are taking the code.

## Star trust

Star growth looks organic.

Star-trust labels are heuristics based on the repository’s behavior, not a check of every stargazer.

## Numbers

- Forks: 1,643
- Issues and pull requests: 15,285
- Watchers: 78
- Average over the last week: 5 per day
- Usual pace: 10 per day
- Stars in the last hour (measured): 1
- Latest release: v1.5.0 (2026-09-21)

## Stars per day, last 30 days (oldest → newest, today is partial)

2026-09-01 … 2026-09-30: 16, 9, 9, 11, 6, 6, 9, 7, 12, 11, 18, 7, 11, 22, 7, 6, 21, 6, 8, 9, 8, 6, 7, 3, 3, 6, 4, 7, 8, 4

## Spotted in now

- GitHub Trending Rust today: #6, +6 stars

## Similar by description

1. **kserve/kserve** — 1.2 · Steady · DevOps & infrastructure · Go · +2 stars today, ≈ 4 by evening
   KServe is a platform for deploying and serving generative and predictive AI models on Kubernetes, supporting multiple frameworks, autoscaling, and a standardized inference protocol.
   Full card: https://gitnova.dev/en/r/kserve/kserve.md
2. **kvcache-ai/Mooncake** — 1.5 · Steady · Language models · C++ · +2 stars today, ≈ 4 by evening
   LLM serving platform built on a KVCache-centric disaggregated architecture: separates prefill and decode and transfers KV cache between nodes over RDMA. Powers Kimi in production at Moonshot AI.
   Full card: https://gitnova.dev/en/r/kvcache-ai/Mooncake.md
3. **kubernetes/kubernetes** — 2.5 · Steady · DevOps & infrastructure · Go · +6 stars today, ≈ 14 by evening
   Kubernetes is an open source container orchestration system for deploying, scaling, and managing containerized applications across multiple hosts.
   Full card: https://gitnova.dev/en/r/kubernetes/kubernetes.md

---

Magnitude (0–10) measures how fast and how unusually interest in a repository is growing right now. It is not a quality score.
Days are UTC. “So far today” is a fact; “expected by the end of the day” is a forecast.
Summaries and use cases are written by an LLM (DeepSeek V4.1 Flash) from the README and may be inaccurate: verify specific claims (benchmarks, speed, hardware) in the repository itself.
Data as of 2026-09-30 14:35 UTC, updated every 30 minutes.