# google-ai-edge/LiteRT-LM

> Google's framework for running large language models on edge devices — phones, laptops, browsers and IoT — with GPU and NPU acceleration. Supports multimodal inputs, function calling and APIs for Python, Kotlin, Swift, JavaScript, Flutter and C++.

- Magnitude: 2.1 out of 10 — Steady
- Stars: 6,610 total · +0 stars measured 2026-10-08, 10:59–11:51 UTC, ≈ 4 by evening
- Star trust: star growth looks organic
- Category: Language models · Language: C++ · License: Apache-2.0 · Created: 2025-04-14 · Last push: 2026-10-08
- GitHub: https://github.com/google-ai-edge/LiteRT-LM · Homepage: https://ai.google.dev/edge/litert-lm · Page: https://gitnova.dev/en/r/google-ai-edge/LiteRT-LM

## Useful for

- Run Gemma or Llama locally on a Raspberry Pi via CLI without cloud
- Embed an on-device LLM into an Android app with Kotlin
- Serve an OpenAI-compatible embeddings endpoint with litert-lm serve

## Why it’s here

- Star-counter measurements on 2026-10-08 (UTC), 10:59–11:51: 6610 → 6610 stars (+0). This is the change over that interval.
- Estimated end-of-day forecast: about +4 stars, using observed gains and the previous day.
- GitHub Trending C++ today: #11, +15 stars.
- Recent forks include notable developers: @uthumany (1,091 followers), @vaimalaviya1233 (578 followers).

## Star trust

Star growth looks organic.

Star-trust labels are heuristics based on the repository’s behavior, not a check of every stargazer.

## Numbers

- Forks: 745
- Issues and pull requests: 3,856
- Watchers: 73
- Average over the last week: 8 per day
- Usual pace: 7 per day
- Stars in the last hour (measured): 0
- Latest release: v0.18.0 (2026-10-06)

## Stars per day, last 30 days (oldest → newest, today is partial)

2026-09-09 … 2026-10-08: 13, 5, 7, 8, 10, 8, 6, 7, 6, 10, 10, 4, 6, 6, 9, 10, 7, 7, 7, 5, 9, 4, 10, 6, 12, 5, 8, 10, 15, 0

## Spotted in now

- GitHub Trending C++ today: #11, +15 stars

## Similar by description

1. **k3s-io/k3s** — 1.0 · Steady · DevOps & infrastructure · Go · +3 stars measured 2026-10-08, 00:09–11:57 UTC, ≈ 6 by evening
   Lightweight Kubernetes distribution packaged as a single binary under 100 MB with lower memory usage, suited for edge, IoT, CI and ARM devices.
   Full card: https://gitnova.dev/en/r/k3s-io/k3s.md

---

Magnitude (0–10) measures how fast and how unusually interest in a repository is growing right now. It is not a quality score.
Days are UTC. “So far today” is a fact; “expected by the end of the day” is a forecast.
Summaries and use cases are written by an LLM (DeepSeek V4.1 Flash) from the README and may be inaccurate: verify specific claims (benchmarks, speed, hardware) in the repository itself.
Data as of 2026-10-08 12:00 UTC, updated every 30 minutes.