GitNova

GitHub seismograph — discoveries and growing interest

lyogavin/airllm

Language modelsJupyter Notebook#chinese-nlp#finetune#generative-ai#instruct-gpt#instruction-set
Total stars
36,103
Today · UTC
+15since 11:04 UTC
Open on GitHub My finds →
More actions

AirLLM 70B inference with single 4GB GPU

Save to My finds to follow releases and star growth. Saved in this browser.

About the project

A library for inference and training of large language models on low-VRAM GPUs: it streams weights layer by layer from disk, letting 70B–671B models run on 4–12 GB of VRAM without quantization or distillation.

Useful for
  • Run Llama 3 70B or DeepSeek-V3 locally on a single consumer GPU with 4–12 GB of VRAM
  • Speed up inference up to 3x by enabling 4bit/8bit block-wise quantization via bitsandbytes
  • Fine-tune a 125B model on an RTX 3060 Ti by keeping adapters on GPU and streaming frozen layers

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate. Read the original README →

4.9 Breakout Magnitude out of 10 — how fast interest is growing, not a quality score.

Star growth looks organic. Data as of October 11, 2026, 11:56 UTC.

The star-growth assessment does not verify whether the project is safe to run.

Stars per day

01,0002,000July 14, 2026October 11, 2026

Bars show stars per UTC day; the line is a moving average of available history. Gaps mean missing data, not zero growth. Today's bar is incomplete. Red marks spike days.

Why it’s trending

  • Star-counter measurements on 2026-10-11 (UTC), 11:04–11:46: 36088 → 36103 stars (+15). This is the change over that interval.
  • Estimated end-of-day forecast: about +139 stars, using observed gains and the previous day.
  • Over the last two days the pace is 7.4× that of the previous week and a half.
  • GitHub Trending today: #7, +541 stars.
  • About 45 forks a day — people are taking the code.

Measured growth: the last 7 completed days

New stars over 7 days: 694. +94% versus the preceding 7 days.

Daily measurements · UTC
October 4, 2026
47
October 5, 2026
44
October 6, 2026
41
October 7, 2026
35
October 8, 2026
28
October 9, 2026
36
October 10, 2026
463

Largest measured day in the last 30 days: 463 · October 10, 2026. Days with data: 30.

Completed days come from GitHub star history; today and forecasts are excluded from this comparison. History checked: October 11, 2026, 11:55 UTC. Sources and measurement limits →

Three GitHub discoveries in each edition

What they do, why they are gaining interest, and what to check before using them.

Editions at 10:00, 16:00, 22:00 MSK.

Share on X Telegram

Numbers

Total stars
36,103
Today
+15 stars measured 2026-10-11, 11:04–11:46 UTC, ≈ 139 by evening
Forks
3,789
Issues and pull requests
332
Watchers
302
Language
Jupyter Notebook
License
Apache-2.0
Latest release
v4.0.0 · September 5, 2026
Created
June 12, 2023
Last push
October 11, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in
README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

GitNova: 4.9
[![GitNova](https://gitnova.dev/badge/lyogavin/airllm.svg?lang=en)](https://gitnova.dev/en/r/lyogavin/airllm)