Mesh-LLM/mesh-llm

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Language modelsRust#agents#ai#decentralized#distributed#llm

1.2 Steady Magnitude out of 10 — how fast interest is growing, not a quality score. Star growth looks organic. Data as of September 24, 2026, 12:27 UTC.

Open on Seismograph Open on GitHub

About the project

Decentralized LLM serving system that pools GPUs and memory across machines and exposes them as one OpenAI-compatible API at localhost:9337. A model can run locally, route to a peer, or be split into layer stages across nodes.

Useful for

Start the public mesh with mesh-llm serve --auto and get a local OpenAI API
Run a private invite-token mesh serving Qwen3-8B for a team
Serve a large dense model via Skippy stage splits across several machines

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.

Why it’s trending

1 star so far today, about 3 expected by the end of the day.
GitHub Trending Rust today: #13, +4 stars.
Recent forks include notable developers: @benthecarman (580 followers).

Stars per day

Bars are daily stars, the line is the usual pace. Red marks spike days.

Numbers

Total stars: 3,447
Today: 1 · ≈ 3 by evening
Forks: 420
Issues and pull requests: 1,976
Watchers: 17
Language: Rust
License: Apache-2.0
Latest release: v0.76.2 · September 14, 2026
Created: February 11, 2026
Last push: September 24, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in

September 24, 2026GitHub Trending Rust today: #13, +4 stars

README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

[![Seismograph](https://gitnova.dev/badge/Mesh-LLM/mesh-llm.svg?lang=en)](https://gitnova.dev/en/r/Mesh-LLM/mesh-llm)

More in this category

8.0
jaredpalmer/kev
kev is a LoRA adapter with a small readout head on top of Qwen2.5-0.5B that answers many typed questions about a document in a single forward pass, returning calibrated probabilities instead of text.

BreakoutLanguage modelsPython+261 stars today, ≈ 733 by evening
6.2
deepopen-com/deepopen
Open-source non-autoregressive System 1 decision engine for typed decisions: returns typed answers (choice, score, noul) in a single forward pass across 100+ languages without generating text. Suited for…

Early signalLanguage modelsPython+21 stars today, ≈ 113 by evening
6.0
taeold/djev-run
Deploys the DiffusionGemma-Jev (djev) model on Google Cloud Run with an NVIDIA RTX PRO 6000 GPU and a TypeSafe AI compatible API. Includes Snake, Dino, and Tetris demos running directly in the browser.

Early signalLanguage modelsHTML+19 stars today, ≈ 95 by evening
5.9
nokia-applied-research/AnyJev
Turns any LLM into a decision model with typed questions (choice, yes/no, score) that return real probabilities read from the next-token distribution, without training. L0 removes position and label-prior bias; L1 adds…

Early signalLanguage modelsPython+43 stars today, ≈ 120 by evening
5.5
mizorewww/laya-mlx
Native MLX runtime for Laya typed decision models: returns probabilities for choices, scores or truth values without text generation, running locally on Apple Silicon.

CoolingLanguage modelsPython+69 stars today, ≈ 202 by evening
4.9
volotat/mini-AGI
A byte-level continual-learning language model that assembles its own architecture, trains from scratch on a single 8 GB VRAM GPU, and keeps learning from everything it reads. An experiment showing continual learning…

Early signalLanguage modelsPython+10 stars today, ≈ 36 by evening