GitNova

GitHub seismograph — discoveries and growing interest

unclecode/crawl4ai

Language modelsPython#ai#ai-agents#crawler#data-extraction#llm
Total stars
84,280
Today
+5
Open on GitHub My finds →
More actions

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

Save to My finds to follow releases and star growth. Saved in this browser.

About the project

Open-source web crawler and scraper that turns pages into clean, LLM-ready Markdown for RAG, agents and data pipelines. Runs via Python API, CLI and Docker with no API keys.

Useful for
  • Build a Markdown corpus from a site for a RAG pipeline
  • Extract structured data from pages using an LLM
  • Run a deep BFS crawl over documentation pages

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate. Read the original README →

2.4 Cooling Magnitude out of 10 — how fast interest is growing, not a quality score.

Star growth looks organic. Data as of September 26, 2026, 10:58 UTC.

The star-growth assessment does not verify whether the project is safe to run.

Stars per day

0300600August 1, 2026October 29, 2026

Bars show stars per UTC day; the line is a moving average of available history. Gaps mean missing data, not zero growth. Today's bar is incomplete. Red marks spike days.

Why it’s trending

  • 5 stars so far today, about 27 expected by the end of the day.
  • Interest is fading: the two-day pace is 34% of the previous week and a half.
  • About 11 forks a day — people are taking the code.

Measured growth: the last 7 completed days

The full 7-day window is unavailable; no weekly total or comparison is calculated.

Daily measurements · UTC
October 22, 2026
—
October 23, 2026
—
October 24, 2026
—
October 25, 2026
—
October 26, 2026
—
October 27, 2026
—
October 28, 2026
—

Completed days come from GitHub star history; today and forecasts are excluded from this comparison. History checked: September 26, 2026, 10:56 UTC. Sources and measurement limits →

Three GitHub discoveries in each edition

What they do, why they are gaining interest, and what to check before using them.

Editions at 10:00, 16:00, 22:00 MSK.

Share on X Telegram

Numbers

Total stars
84,280
Today
+5 stars on 2026-09-26 (UTC), ≈ 27 by evening
Forks
8,716
Issues and pull requests
1,823
Watchers
418
Language
Python
License
Apache-2.0
Latest release
v0.9.4 · September 23, 2026
Created
May 9, 2024
Last push
September 25, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in
README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

GitNova: 2.4
[![GitNova](https://gitnova.dev/badge/unclecode/crawl4ai.svg?lang=en)](https://gitnova.dev/en/r/unclecode/crawl4ai)