FlashML-org/FreeToken

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

Language modelsPython#deepseek-v4#edge#glm#inference#minimax

2.9 Steady Magnitude out of 10. Star growth looks organic. Data as of September 14, 2026.

About the project

A Mixture-of-Experts inference engine for running frontier-scale open-weight MoE models (290B+) on consumer hardware — GPUs, CPUs, and host memory. Aimed at users who want to run frontier models locally.

Useful for

Run a large MoE model locally on a gaming PC via the GUI app or CLI.
Connect a local model to coding agents (Codex, Claude Code) through the OpenAI/Anthropic-compatible API.
Re-allocate VRAM between expert cache and KV cache without restarting the engine.

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.

Why it’s trending

69 stars today.
Interest is fading: the two-day pace is 50% of the previous week and a half.
The repository is 55 days old and already has 12,707 stars.
Top new repositories in the last 4 months: #23.
About 17 forks a day — people are taking the code.

Stars per day

Bars are daily stars, the line is the usual pace. Red marks spike days.

Numbers

Total stars: 12,710
Stars in a day: 70
Forks: 1,238
Issues and pull requests: 460
Watchers: 102
Language: Python
License: Apache-2.0
Latest release: nightly · September 9, 2026
Created: July 20, 2026
Last push: September 14, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in

September 14, 2026Top new repositories in the last 4 months: #23
September 13, 2026Top new repositories in the last 4 months: #23

README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

[![Seismograph](https://gitnova.dev/badge/FlashML-org/FreeToken.svg?lang=en)](https://gitnova.dev/en/r/FlashML-org/FreeToken)

Similar projects

6.1
JustVugg/colibri
A pure-C, zero-dependency inference engine for running large MoE models (744B–2.8T parameters) on consumer hardware by treating VRAM, RAM, and storage as a single multitier hierarchy and streaming experts from disk.

BreakoutLanguage modelsC+1,048 stars in a day
5.7
asgeirtj/system_prompts_leaks
A collection of extracted system prompts from Anthropic, OpenAI, Google, xAI and others — the hidden instructions chatbots receive before a user's first message.

BreakoutLanguage modelsJavaScript+428 stars in a day
5.1
kennethwolters/litelm
A lightweight litellm alternative: routes LLM calls across 19 providers and translates message formats in ~2,900 lines with two dependencies, without proxy, caching, or cost tracking.

Early signalLanguage modelsPython+9 stars in a day
5.0
MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-Sparks
A local EXL3 2.9 bpw checkpoint of DeepSeek-V4.1-Flash (196 GiB, 39 shards) served via an OpenAI-compatible vLLM API on a 2x NVIDIA GB10 (DGX Spark) kit with tensor-parallel 2. Includes DSpark speculative decoding and…

Early signalLanguage modelsPython+81 stars in a day
4.8
unclecode/crawl4ai
Open-source web crawler and scraper that turns pages into clean, LLM-ready Markdown for RAG, agents and data pipelines. Runs via Python API, CLI and Docker with no API keys.

BreakoutLanguage modelsPython+411 stars in a day
4.5
Edge0-AI/Edge0
An open-source streaming MoE inference framework: expert weights are offloaded from SSD on demand while a trained prerouter predicts routing ahead of time. Runs on Apple Silicon via MLX and ships with two ready-to-run…

CoolingLanguage modelsPython+118 stars in a day