0xSero/dsv41-flash-offload
More actions
DeepSeek-V4.1-Flash EXL3 on one 24 GB RTX 3090 + DDR4 + NVMe: staged-DMA prefill, AVX2 CPU expert tier, elastic VRAM expert cache, Engram on disk, OpenAI API
Save to My finds to follow releases and star growth. Saved in this browser.
About the project
Serves DeepSeek-V4.1-Flash (EXL3 3.0 bpw) on a single 24 GB RTX 3090 by offloading experts to DDR4 and NVMe, exposing an OpenAI-compatible API. Aimed at running a large MoE model locally on consumer hardware.
Useful for
- Run a local OpenAI-compatible DeepSeek-V4.1-Flash server on a single RTX 3090
- Process long contexts up to 262k tokens for retrieval and coding tasks
- Build the pinned-digest Docker image for reproducible deployment
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.
Star growth looks organic. Data as of October 5, 2026, 19:20 UTC.
The star-growth assessment does not verify whether the project is safe to run.
Stars per day
Bars show daily stars; the line is a moving average of the available history. Short histories do not yet establish a reliable usual pace. Red marks spike days.
Why it’s trending
- Star-counter measurements on 2026-10-05 (UTC), 18:11–19:14: 67 → 70 stars (+3). This is the change over that interval.
- Estimated end-of-day forecast: about +4 stars, using observed gains and the previous day.
- The repository is 3 days old and already has 70 stars. With less than two weeks of history, there's no usual pace to compare the spike against yet.
- Top new repositories this week: #189.
- Recent forks include notable developers: @0xSojalSec (1,006 followers).
Three GitHub discoveries in each edition
What they do, why they are gaining interest, and what to check before using them.
Editions at 10:00, 16:00, 22:00 MSK.
Numbers
- Total stars
- 70
- Today
- +3 stars measured 2026-10-05, 18:11–19:14 UTC, ≈ 4 by evening
- Forks
- 9
- Issues and pull requests
- 0
- Watchers
- 0
- Language
- Python
- License
- MIT
- Created
- October 2, 2026
- Last push
- October 5, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- October 5, 2026Top new repositories this week: #188