Inferact/tpu-megakernels
A collection of megakernels for TPU
About the project
A collection of fused megakernels for LLM inference on TPU, targeting Kimi K3 and Qwen3.8-27B with speculative decoding, reaching up to ~2x the decode throughput of a GB200 baseline at batch sizes 1 to 8.
Useful for
- Start an OpenAI-compatible Qwen3.8-27B server on a single host with eight TPUs for chat inference
- Run the CPU correctness tests on 32 virtual devices without TPU hardware
- Benchmark Kimi K3 decode throughput with DSpark against the GB200 baseline
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.
Why it’s trending
- 0 stars so far today, about 24 expected by the end of the day.
- The spike has held for 3 days in a row — not a one-off blip.
- The repository is 2 days old and already has 95 stars. With less than two weeks of history, there's no usual pace to compare the spike against yet.
- Top new repositories this week: #162.
Stars per day
Bars are daily stars, the line is the usual pace. Red marks spike days.
Numbers
- Total stars
- 95
- Today
- 0 · ≈ 24 by evening
- Forks
- 2
- Issues and pull requests
- 1
- Watchers
- 1
- Language
- Python
- License
- Apache-2.0
- Created
- September 23, 2026
- Last push
- September 25, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 25, 2026Top new repositories this week: #162
Similar by description
-
1.1
MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-Sparks
A local EXL3 2.9 bpw checkpoint of DeepSeek-V4.1-Flash (196 GiB, 39 shards) served via an OpenAI-compatible vLLM API on a 2x NVIDIA GB10 (DGX Spark) kit with tensor-parallel 2. Includes DSpark speculative decoding and…
-
2.1
MiaAI-Lab/DeepSeek-v4.1-Flash-DGX-Sparks
Scripts and patches to serve DeepSeek-V4.1-Flash with SGLang across a 3–4 node NVIDIA DGX Spark cluster, using MXFP4/FP8, speculative decoding and an OpenAI-compatible endpoint.