Edge0-AI/Edge0
About the project
An open-source streaming MoE inference framework: expert weights are offloaded from SSD on demand while a trained prerouter predicts routing ahead of time. Runs on Apple Silicon via MLX and ships with two ready-to-run model tiers (35B and 8B).
Useful for
- Run a 35B MoE model on a Mac with 16 GB RAM without loading all experts into memory
- Serve an OpenAI-compatible /v1/chat/completions endpoint via edge0 serve
- Plug in a custom backend (e.g. CUDA) through the edge0/backends/base.py facade
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.
Why it’s trending
- 117 stars today.
- Interest is fading: the two-day pace is 29% of the previous week and a half.
- The spike has held for 3 days in a row — not a one-off blip.
- The repository is 5 days old and already has 1,595 stars.
- Top new repositories this week: #3.
- Top new repositories this month: #36.
- About 16 forks a day — people are taking the code.
Stars per day
Bars are daily stars, the line is the usual pace. Red marks spike days.
Numbers
- Total stars
- 1,597
- Stars in a day
- 118
- Forks
- 130
- Issues and pull requests
- 25
- Watchers
- 10
- Language
- Python
- License
- Apache-2.0
- Created
- September 8, 2026
- Last push
- September 13, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 14, 2026Top new repositories this week: #2; Top new repositories this month: #35
- September 13, 2026Top new repositories this week: #3; Top new repositories this month: #36
Share
README badge
Paste it into your README — the badge shows the current magnitude and links to this page.
[](https://gitnova.dev/en/r/Edge0-AI/Edge0)Similar projects
-
6.1
JustVugg/colibri
A pure-C, zero-dependency inference engine for running large MoE models (744B–2.8T parameters) on consumer hardware by treating VRAM, RAM, and storage as a single multitier hierarchy and streaming experts from disk.
-
5.7
asgeirtj/system_prompts_leaks
A collection of extracted system prompts from Anthropic, OpenAI, Google, xAI and others — the hidden instructions chatbots receive before a user's first message.
-
5.1
kennethwolters/litelm
A lightweight litellm alternative: routes LLM calls across 19 providers and translates message formats in ~2,900 lines with two dependencies, without proxy, caching, or cost tracking.
-
5.0
MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-Sparks
A local EXL3 2.9 bpw checkpoint of DeepSeek-V4.1-Flash (196 GiB, 39 shards) served via an OpenAI-compatible vLLM API on a 2x NVIDIA GB10 (DGX Spark) kit with tensor-parallel 2. Includes DSpark speculative decoding and…
-
4.8
unclecode/crawl4ai
Open-source web crawler and scraper that turns pages into clean, LLM-ready Markdown for RAG, agents and data pipelines. Runs via Python API, CLI and Docker with no API keys.
-
4.4
huggingface/transformers
Model-definition framework for state-of-the-art pretrained ML models (text, vision, audio, multimodal) for inference and training, compatible with most training and inference engines.