google-ai-edge/LiteRT
LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization
About the project
LiteRT is Google's on-device runtime for high-performance ML and GenAI deployment on edge platforms, the successor to TensorFlow Lite. It converts models from PyTorch, TensorFlow, and JAX into .tflite or .litertlm format and runs them on CPU, GPU, and NPU.
Useful for
- Convert a PyTorch model to .tflite with LiteRT Torch Converter
- Run a quantized LLM on an Android device with NPU acceleration
- Deploy client-side ML inference in the browser via WebGPU and WASM with LiteRT.js
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.
Why it’s trending
- 1 star so far today, about 2 expected by the end of the day.
- GitHub Trending C++ today: #8, +5 stars.
- Recent forks include notable developers: @onuralpszr (805 followers), @Surfndez (380 followers).
Stars per day
Bars are daily stars, the line is the usual pace. Red marks spike days.
Numbers
- Total stars
- 3,437
- Today
- 1 · ≈ 2 by evening
- Forks
- 460
- Issues and pull requests
- 10,261
- Watchers
- 27
- Language
- C++
- License
- Apache-2.0
- Latest release
- v2.2.0 · August 13, 2026
- Created
- September 4, 2024
- Last push
- September 25, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 25, 2026GitHub Trending C++ today: #8, +5 stars
Share
README badge
Paste it into your README — the badge shows the current magnitude and links to this page.
[](https://gitnova.dev/en/r/google-ai-edge/LiteRT)Similar by description
-
1.3
microsoft/onnxruntime
Cross-platform accelerator for ML inference and training. Runs models from PyTorch, TensorFlow, scikit-learn and others via the ONNX format with graph optimizations and hardware acceleration.
-
1.1
openvinotoolkit/openvino
OpenVINO is an open-source toolkit for optimizing and deploying deep learning model inference on Intel CPU, GPU and NPU. It supports models from PyTorch, TensorFlow, ONNX, Keras, PaddlePaddle, JAX/Flax and Hugging Face…
-
1.4
NVIDIA/TensorRT-LLM
NVIDIA library for optimizing inference of large language models and visual generative models on GPUs, with a Python API, specialized kernels, and an efficient C++/Python runtime.
-
1.1
openxla/xla
XLA (Accelerated Linear Algebra) is an open-source ML compiler for GPUs, CPUs, and ML accelerators. It takes models from PyTorch, TensorFlow, and JAX and optimizes them for high-performance execution across different…
-
2.8
General-Instinct/InstinctFlash
A high-performance serving runtime for robotics models (VLA, WAM, policies) with FP8 acceleration and optimized kernels on Jetson Thor and RTX 4090/5090.
-
5.7
NVIDIA/Model-Optimizer
NVIDIA library for compressing and accelerating models: quantization, pruning, distillation, NAS and speculative decoding with export to TensorRT-LLM, vLLM, SGLang. For ML engineers preparing models for deployment.