GitNova

GitHub seismograph — discoveries and growing interest

FareedKhan-dev/train-llm-from-scratch

Language modelsPython#gemini#large-language-models#llm#openai#training
Total stars
11,931
Today
+3
Open on GitHub My finds →
More actions

A straightforward method for training your LLM, from downloading data to generating text.

Save to My finds to follow releases and star growth. Saved in this browser.

About the project

Educational project: a from-scratch PyTorch Transformer plus a full LLM training pipeline — from raw text through SFT, reward modeling, PPO/DPO/GRPO to chat, without transformers, trl or peft.

Useful for
  • Train a small LLM on a single GPU following the README steps
  • Study attention and Transformer internals from the source code
  • Walk through post-training stages: SFT, reward model, DPO, PPO, GRPO

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate. Read the original README →

How to get started

git clone https://github.com/FareedKhan-dev/train-llm-from-scratch.git
cd train-llm-from-scratch
pip install -e .

Copied as is from the “setup” section of the README. GitNova has not run these commands: check them in the original before running. Full instructions →

1.4 Cooling Magnitude out of 10 — how fast interest is growing, not a quality score.

Star growth looks organic. Data as of October 3, 2026, 10:57 UTC.

The star-growth assessment does not verify whether the project is safe to run.

Stars per day

0300600August 19, 2026November 16, 2026

Bars show stars per UTC day; the line is a moving average of available history. Gaps mean missing data, not zero growth. Today's bar is incomplete. Red marks spike days.

Why it’s trending

  • 3 stars so far today, about 11 expected by the end of the day.
  • Interest is fading: the two-day pace is 9% of the previous week and a half.

Measured growth: the last 7 completed days

The full 7-day window is unavailable; no weekly total or comparison is calculated.

Daily measurements · UTC
November 9, 2026
—
November 10, 2026
—
November 11, 2026
—
November 12, 2026
—
November 13, 2026
—
November 14, 2026
—
November 15, 2026
—

Completed days come from GitHub star history; today and forecasts are excluded from this comparison. History checked: October 3, 2026, 10:56 UTC. Sources and measurement limits →

Three GitHub discoveries in each edition

What they do, why they are gaining interest, and what to check before using them.

Editions at 10:00, 16:00, 22:00 MSK.

Share on X Telegram

Numbers

Total stars
11,931
Today
+3 stars on 2026-10-03 (UTC), ≈ 11 by evening
Forks
1,642
Issues and pull requests
41
Watchers
87
Language
Python
License
MIT
Created
January 12, 2025
Last push
October 2, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in
README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

GitNova: 1.4
[![GitNova](https://gitnova.dev/badge/FareedKhan-dev/train-llm-from-scratch.svg?lang=en)](https://gitnova.dev/en/r/FareedKhan-dev/train-llm-from-scratch)