# Mesh-LLM/mesh-llm

> Decentralized LLM serving system that pools GPUs and memory across machines and exposes them as one OpenAI-compatible API at localhost:9337. A model can run locally, route to a peer, or be split into layer stages across nodes.

- Magnitude: 1.3 out of 10 — Steady
- Stars: 3,448 total · +2 stars today, ≈ 4 by evening
- Star trust: star growth looks organic
- Category: Language models · Language: Rust · License: Apache-2.0 · Created: 2026-02-11 · Last push: 2026-09-24
- GitHub: https://github.com/Mesh-LLM/mesh-llm · Homepage: http://meshllm.cloud/ · Page: https://gitnova.dev/en/r/Mesh-LLM/mesh-llm

## Useful for

- Start the public mesh with mesh-llm serve --auto and get a local OpenAI API
- Run a private invite-token mesh serving Qwen3-8B for a team
- Serve a large dense model via Skippy stage splits across several machines

## Why it’s here

- 2 stars so far today, about 4 expected by the end of the day.
- GitHub Trending Rust today: #13, +4 stars.
- Recent forks include notable developers: @benthecarman (580 followers).

## Star trust

Star growth looks organic.

Star-trust labels are heuristics based on the repository’s behavior, not a check of every stargazer.

## Numbers

- Forks: 420
- Issues and pull requests: 1,976
- Watchers: 17
- Average over the last week: 5 per day
- Usual pace: 6 per day
- Stars in the last hour (measured): 1
- Latest release: v0.76.2 (2026-09-14)

## Stars per day, last 30 days (oldest → newest, today is partial)

2026-08-26 … 2026-09-24: 5, 4, 13, 7, 8, 5, 9, 5, 0, 3, 0, 1, 1, 4, 7, 3, 15, 10, 5, 6, 5, 2, 2, 7, 3, 4, 0, 13, 5, 2

## Spotted in now

- GitHub Trending Rust today: #13, +4 stars

## More in this category

1. **jaredpalmer/kev** — 8.0 · Breakout · Language models · Python · +281 stars today, ≈ 707 by evening
   kev is a LoRA adapter with a small readout head on top of Qwen2.5-0.5B that answers many typed questions about a document in a single forward pass, returning calibrated probabilities instead of text.
   Full card: https://gitnova.dev/en/r/jaredpalmer/kev.md
2. **deepopen-com/deepopen** — 6.2 · Early signal · Language models · Python · +23 stars today, ≈ 105 by evening
   Open-source non-autoregressive System 1 decision engine for typed decisions: returns typed answers (choice, score, noul) in a single forward pass across 100+ languages without generating text. Suited for classification, routing and…
   Full card: https://gitnova.dev/en/r/deepopen-com/deepopen.md
3. **taeold/djev-run** — 6.0 · Early signal · Language models · HTML · +21 stars today, ≈ 88 by evening
   Deploys the DiffusionGemma-Jev (djev) model on Google Cloud Run with an NVIDIA RTX PRO 6000 GPU and a TypeSafe AI compatible API. Includes Snake, Dino, and Tetris demos running directly in the browser.
   Full card: https://gitnova.dev/en/r/taeold/djev-run.md
4. **nokia-applied-research/AnyJev** — 5.9 · Early signal · Language models · Python · +47 stars today, ≈ 116 by evening
   Turns any LLM into a decision model with typed questions (choice, yes/no, score) that return real probabilities read from the next-token distribution, without training. L0 removes position and label-prior bias; L1 adds temperature…
   Full card: https://gitnova.dev/en/r/nokia-applied-research/AnyJev.md
5. **mizorewww/laya-mlx** — 5.5 · Cooling · Language models · Python · +77 stars today, ≈ 198 by evening
   Native MLX runtime for Laya typed decision models: returns probabilities for choices, scores or truth values without text generation, running locally on Apple Silicon.
   Full card: https://gitnova.dev/en/r/mizorewww/laya-mlx.md

---

Magnitude (0–10) measures how fast and how unusually interest in a repository is growing right now. It is not a quality score.
Days are UTC. “So far today” is a fact; “expected by the end of the day” is a forecast.
Summaries and use cases are written by an LLM (DeepSeek V4.1 Flash) from the README and may be inaccurate: verify specific claims (benchmarks, speed, hardware) in the repository itself.
Data as of 2026-09-24 13:15 UTC, updated every 30 minutes.