youssofal/MTPLX

3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

Language modelsPython#apple-silicon#local-ai#mlx#mtp#openai-compatible

2.2 Steady Magnitude out of 10. Star growth looks organic. Data as of September 14, 2026.

About the project

Run local LLMs on Apple Silicon with native multi-token prediction (MTP) speculative decoding and no external drafter; speeds up inference 1.6–2.2x while keeping the same output distribution.

Useful for

Start a local OpenAI-compatible server on a Mac and point Claude Code or Open WebUI at it
Auto-tune MTP draft depth for a specific chip with mtplx tune
Build and verify an MTP adapter for a Hugging Face model via mtplx forge

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.

Why it’s trending

10 stars today.
Recent forks include notable developers: @janishar (2,258 followers).

Stars per day

Bars are daily stars, the line is the usual pace. Red marks spike days.

Numbers

Total stars: 2,300
Stars in a day: 10
Forks: 171
Issues and pull requests: 495
Watchers: 18
Language: Python
License: Apache-2.0
Latest release: v2.11.2 · September 6, 2026
Created: May 2, 2026
Last push: September 6, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in

September 13, 2026GitHub Trending this month: #13, +1,116 stars

README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

[![Seismograph](https://gitnova.dev/badge/youssofal/MTPLX.svg?lang=en)](https://gitnova.dev/en/r/youssofal/MTPLX)

Similar projects

6.1
JustVugg/colibri
A pure-C, zero-dependency inference engine for running large MoE models (744B–2.8T parameters) on consumer hardware by treating VRAM, RAM, and storage as a single multitier hierarchy and streaming experts from disk.

BreakoutLanguage modelsC+1,048 stars in a day
5.7
asgeirtj/system_prompts_leaks
A collection of extracted system prompts from Anthropic, OpenAI, Google, xAI and others — the hidden instructions chatbots receive before a user's first message.

BreakoutLanguage modelsJavaScript+428 stars in a day
5.1
kennethwolters/litelm
A lightweight litellm alternative: routes LLM calls across 19 providers and translates message formats in ~2,900 lines with two dependencies, without proxy, caching, or cost tracking.

Early signalLanguage modelsPython+9 stars in a day
5.0
MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-Sparks
A local EXL3 2.9 bpw checkpoint of DeepSeek-V4.1-Flash (196 GiB, 39 shards) served via an OpenAI-compatible vLLM API on a 2x NVIDIA GB10 (DGX Spark) kit with tensor-parallel 2. Includes DSpark speculative decoding and…

Early signalLanguage modelsPython+81 stars in a day
4.8
unclecode/crawl4ai
Open-source web crawler and scraper that turns pages into clean, LLM-ready Markdown for RAG, agents and data pipelines. Runs via Python API, CLI and Docker with no API keys.

BreakoutLanguage modelsPython+411 stars in a day
4.5
Edge0-AI/Edge0
An open-source streaming MoE inference framework: expert weights are offloaded from SSD on demand while a trained prerouter predicts routing ahead of time. Runs on Apple Silicon via MLX and ships with two ready-to-run…

CoolingLanguage modelsPython+118 stars in a day