microsoft/onnxruntime-genai
- Total stars
- 1,127
- Today
- +0
Save to My finds to follow releases and star growth. Saved in this browser.
About the project
A C++ library for running generative AI models (LLMs) on-device via ONNX Runtime: it implements the generative loop, pre/post-processing, KV cache management, search and sampling, and grammar constraints for tool calling. APIs are available for Python, C#, C/C++, and Java.
Useful for
- Run local LLMs like Phi, Llama, or Qwen on CPU without cloud services
- Build a desktop or mobile app with offline text generation in C#, Python, or Java
- Constrain model output with a grammar to enable tool calling
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate. Read the original README →
Star growth looks organic. Data as of September 28, 2026, 10:29 UTC.
The star-growth assessment does not verify whether the project is safe to run.
Stars per day
Bars show stars per UTC day; the line is a moving average of available history. Gaps mean missing data, not zero growth. Today's bar is incomplete. Red marks spike days.
Why it’s trending
- A steady background without notable changes.
Measured growth: the last 7 completed days
The full 7-day window is unavailable; no weekly total or comparison is calculated.
Daily measurements · UTC
- October 26, 2026
- —
- October 27, 2026
- —
- October 28, 2026
- —
- October 29, 2026
- —
- October 30, 2026
- —
- October 31, 2026
- —
- November 1, 2026
- —
Completed days come from GitHub star history; today and forecasts are excluded from this comparison. History checked: September 23, 2026, 01:59 UTC. Sources and measurement limits →
Three GitHub discoveries in each edition
What they do, why they are gaining interest, and what to check before using them.
Editions at 10:00, 16:00, 22:00 MSK.
Numbers
- Total stars
- 1,127
- Today
- +0 stars on 2026-09-28 (UTC), ≈ 0 by evening
- Forks
- 356
- Issues and pull requests
- 2,481
- Watchers
- 48
- Language
- C++
- License
- MIT
- Latest release
- v0.16.0 · September 22, 2026
- Created
- November 13, 2023
- Last push
- September 23, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 18, 2026GitHub Trending C++ today: #16, +1 star
- September 17, 2026GitHub Trending C++ today: #16, +1 star
README badge
Paste it into your README — the badge shows the current magnitude and links to this page.
[](https://gitnova.dev/en/r/microsoft/onnxruntime-genai)