openvinotoolkit/openvino
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
About the project
OpenVINO is an open-source toolkit for optimizing and deploying deep learning model inference on Intel CPU, GPU and NPU. It supports models from PyTorch, TensorFlow, ONNX, Keras, PaddlePaddle, JAX/Flax and Hugging Face with C++, Python, C and NodeJS APIs.
Useful for
- Convert a PyTorch or TensorFlow model to OpenVINO and run inference on CPU
- Accelerate LLM or diffusion model inference with the OpenVINO GenAI API
- Deploy a model on an Intel NPU or discrete GPU for edge devices
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.
Why it’s trending
- 1 star so far today, about 3 expected by the end of the day.
- GitHub Trending C++ today: #8, +6 stars.
- Recent forks include notable developers: @thc1006 (307 followers).
Stars per day
Bars are daily stars, the line is the usual pace. Red marks spike days.
Numbers
- Total stars
- 10,872
- Stars in a day
- 3
- Forks
- 3,388
- Issues and pull requests
- 37,747
- Watchers
- 191
- Language
- C++
- License
- Apache-2.0
- Latest release
- 2026.4.0 · September 16, 2026
- Created
- October 15, 2018
- Last push
- September 19, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 19, 2026GitHub Trending C++ today: #8, +6 stars
Similar projects
-
7.7
TheoLeeCJ/SemIf
An open reproduction of the Jev-style semantic decision interface: reads typed option probabilities directly from a 4B model's logits without generating text. Runs on a single RTX 3090.
-
7.4
TianyuCodings/NanoJev
A nano replica of Jev built on Qwen3-0.6B that outputs probability distributions over candidates in a single forward pass with no token decoding, plus a training pipeline and game demos (maze, Snake).
-
6.4
Continuum-AI-Corp/OrcaBonsai-27B-Uncensored
A tool for runtime refusal ablation in the compressed Ternary Bonsai 2 27B LLM: it projects the residual stream to remove the refusal direction without modifying or re-quantizing weights. Runs on Apple Silicon via MLX.
-
6.1
jaredpalmer/kev
kev is a LoRA adapter with a small readout head on top of Qwen2.5-0.5B that answers many typed questions about a document in a single forward pass, returning calibrated probabilities instead of text.
-
6.0
githubnext/localjev
A local TypeScript/Bun HTTP service implementing a Jev-compatible POST /v1/systemone API on top of an OpenAI-compatible Chat Completions endpoint (DiffusionGemma via oMLX). It acts as a bridge for typed decisions…
-
6.0
higgsfield-ai/higgsfield
Fault-tolerant GPU orchestration and ML framework for distributed training of models with billions to trillions of parameters, including LLMs. Manages node access, experiment queueing, and GitHub Actions integration.