GitNova

GitHub seismograph — discoveries and growing interest

yifanzhang-pro/KLPO

Language modelsPython
Total stars
182
Today
—No data
Open on GitHub My finds →
More actions

Official Project Page for KL-Regularized Policy Optimization for Agentic Reinforcement Learning (KLPO)

Save to My finds to follow releases and star growth. Saved in this browser.

About the project

KLPO is a critic-free, single-rollout reinforcement learning method for training agentic language models, using token regression and Monte Carlo KL estimation instead of value models or response groups. It provides the loss implementation, CPU tests, and a native Molt training integration.

Useful for
  • Train an agentic LLM with KLPO loss using the provided Molt launcher
  • Run the CPU toy example to verify all eight route/estimator combinations
  • Compare MC-KL, TopK-KL, Binary KL and Full KL estimators on a small policy

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate. Read the original README →

How to get started

git clone https://github.com/yifanzhang-pro/KLPO.git
cd KLPO
python -m venv .venv
source .venv/bin/activate
pip install -e '.[test]'

python examples/train_toy.py # Default: token regression + MC-KL, M=128
python examples/train_toy.py --mc-samples 1
python -m pytest -q

Copied as is from the “quick start” section of the README. GitNova has not run these commands: check them in the original before running. Full instructions →

0.0 Quiet Magnitude out of 10 — how fast interest is growing, not a quality score.

Star growth looks organic. Data as of October 5, 2026, 23:47 UTC.

The star-growth assessment does not verify whether the project is safe to run.

Stars per day

050100September 19, 2026November 16, 2026

Bars show stars per UTC day; the line is a moving average of available history. Gaps mean missing data, not zero growth. Today's bar is incomplete. Red marks spike days.

Why it’s trending

  • There are not enough fresh counter measurements for today's UTC day. The gain is unknown.
  • The repository is 16 days old and already has 182 stars.

Measured growth: the last 7 completed days

The full 7-day window is unavailable; no weekly total or comparison is calculated.

Daily measurements · UTC
November 9, 2026
—
November 10, 2026
—
November 11, 2026
—
November 12, 2026
—
November 13, 2026
—
November 14, 2026
—
November 15, 2026
—

Completed days come from GitHub star history; today and forecasts are excluded from this comparison. History checked: September 29, 2026, 00:16 UTC. Sources and measurement limits →

Three GitHub discoveries in each edition

What they do, why they are gaining interest, and what to check before using them.

Editions at 10:00, 16:00, 22:00 MSK.

Share on X Telegram

Numbers

Total stars
182
Today
Not enough measurements today
Forks
16
Issues and pull requests
1
Watchers
2
Language
Python
License
Apache-2.0
Created
September 19, 2026
Last push
September 21, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in
README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

GitNova: 0.0
[![GitNova](https://gitnova.dev/badge/yifanzhang-pro/KLPO.svg?lang=en)](https://gitnova.dev/en/r/yifanzhang-pro/KLPO)