FareedKhan-dev/train-llm-from-scratch
- Total stars
- 11,931
- Today
- +3
More actions
A straightforward method for training your LLM, from downloading data to generating text.
Save to My finds to follow releases and star growth. Saved in this browser.
About the project
Educational project: a from-scratch PyTorch Transformer plus a full LLM training pipeline — from raw text through SFT, reward modeling, PPO/DPO/GRPO to chat, without transformers, trl or peft.
Useful for
- Train a small LLM on a single GPU following the README steps
- Study attention and Transformer internals from the source code
- Walk through post-training stages: SFT, reward model, DPO, PPO, GRPO
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate. Read the original README →
How to get started
git clone https://github.com/FareedKhan-dev/train-llm-from-scratch.git
cd train-llm-from-scratch
pip install -e .
Copied as is from the “setup” section of the README. GitNova has not run these commands: check them in the original before running. Full instructions →
Star growth looks organic. Data as of October 3, 2026, 10:57 UTC.
The star-growth assessment does not verify whether the project is safe to run.
Stars per day
Bars show stars per UTC day; the line is a moving average of available history. Gaps mean missing data, not zero growth. Today's bar is incomplete. Red marks spike days.
Why it’s trending
- 3 stars so far today, about 11 expected by the end of the day.
- Interest is fading: the two-day pace is 9% of the previous week and a half.
Measured growth: the last 7 completed days
The full 7-day window is unavailable; no weekly total or comparison is calculated.
Daily measurements · UTC
- November 9, 2026
- —
- November 10, 2026
- —
- November 11, 2026
- —
- November 12, 2026
- —
- November 13, 2026
- —
- November 14, 2026
- —
- November 15, 2026
- —
Completed days come from GitHub star history; today and forecasts are excluded from this comparison. History checked: October 3, 2026, 10:56 UTC. Sources and measurement limits →
Three GitHub discoveries in each edition
What they do, why they are gaining interest, and what to check before using them.
Editions at 10:00, 16:00, 22:00 MSK.
Numbers
- Total stars
- 11,931
- Today
- +3 stars on 2026-10-03 (UTC), ≈ 11 by evening
- Forks
- 1,642
- Issues and pull requests
- 41
- Watchers
- 87
- Language
- Python
- License
- MIT
- Created
- January 12, 2025
- Last push
- October 2, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 23, 2026GitHub Trending Python today: #7, +141 stars
- September 22, 2026GitHub Trending Python today: #6, +220 stars
- September 21, 2026GitHub Trending Python today: #5, +265 stars
- September 20, 2026GitHub Trending Python today: #5, +196 stars