NVIDIA/TensorRT-LLM
- Total stars
- 14,746
- Today
- +1
More actions
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Save to My finds to follow releases and star growth. Saved in this browser.
About the project
NVIDIA library for optimizing inference of large language models and visual generative models on GPUs, with a Python API, specialized kernels, and an efficient C++/Python runtime.
Useful for
- Deploy a high-throughput LLM inference server on NVIDIA GPUs
- Speed up video and image generation with quantization and optimized kernels
- Configure speculative decoding and KV cache to reduce latency
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate. Read the original README →
Star growth looks organic. Data as of September 30, 2026, 10:54 UTC.
The star-growth assessment does not verify whether the project is safe to run.
Stars per day
Bars show stars per UTC day; the line is a moving average of available history. Gaps mean missing data, not zero growth. Today's bar is incomplete. Red marks spike days.
Why it’s trending
- 1 star so far today, about 5 expected by the end of the day.
- Recent forks include notable developers: @jiazhihao (610 followers).
Measured growth: the last 7 completed days
The full 7-day window is unavailable; no weekly total or comparison is calculated.
Daily measurements · UTC
- October 27, 2026
- —
- October 28, 2026
- —
- October 29, 2026
- —
- October 30, 2026
- —
- October 31, 2026
- —
- November 1, 2026
- —
- November 2, 2026
- —
Completed days come from GitHub star history; today and forecasts are excluded from this comparison. History checked: September 30, 2026, 10:54 UTC. Sources and measurement limits →
Three GitHub discoveries in each edition
What they do, why they are gaining interest, and what to check before using them.
Editions at 10:00, 16:00, 22:00 MSK.
Numbers
- Total stars
- 14,746
- Today
- +1 star on 2026-09-30 (UTC), ≈ 4 by evening
- Forks
- 2,782
- Issues and pull requests
- 19,485
- Watchers
- 123
- Language
- Python
- Latest release
- v1.3.0rc29 · September 29, 2026
- Created
- August 16, 2023
- Last push
- September 30, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 20, 2026GitHub Trending Python today: #5, +14 stars
- September 19, 2026GitHub Trending Python today: #5, +16 stars
README badge
Paste it into your README — the badge shows the current magnitude and links to this page.
[](https://gitnova.dev/en/r/NVIDIA/TensorRT-LLM)