yifanzhang-pro/KLPO
- Total stars
- 182
- Today
- —No data
More actions
Official Project Page for KL-Regularized Policy Optimization for Agentic Reinforcement Learning (KLPO)
Save to My finds to follow releases and star growth. Saved in this browser.
About the project
KLPO is a critic-free, single-rollout reinforcement learning method for training agentic language models, using token regression and Monte Carlo KL estimation instead of value models or response groups. It provides the loss implementation, CPU tests, and a native Molt training integration.
Useful for
- Train an agentic LLM with KLPO loss using the provided Molt launcher
- Run the CPU toy example to verify all eight route/estimator combinations
- Compare MC-KL, TopK-KL, Binary KL and Full KL estimators on a small policy
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate. Read the original README →
How to get started
git clone https://github.com/yifanzhang-pro/KLPO.git
cd KLPO
python -m venv .venv
source .venv/bin/activate
pip install -e '.[test]'
python examples/train_toy.py # Default: token regression + MC-KL, M=128
python examples/train_toy.py --mc-samples 1
python -m pytest -q
Copied as is from the “quick start” section of the README. GitNova has not run these commands: check them in the original before running. Full instructions →
Star growth looks organic. Data as of October 5, 2026, 23:47 UTC.
The star-growth assessment does not verify whether the project is safe to run.
Stars per day
Bars show stars per UTC day; the line is a moving average of available history. Gaps mean missing data, not zero growth. Today's bar is incomplete. Red marks spike days.
Why it’s trending
- There are not enough fresh counter measurements for today's UTC day. The gain is unknown.
- The repository is 16 days old and already has 182 stars.
Measured growth: the last 7 completed days
The full 7-day window is unavailable; no weekly total or comparison is calculated.
Daily measurements · UTC
- November 9, 2026
- —
- November 10, 2026
- —
- November 11, 2026
- —
- November 12, 2026
- —
- November 13, 2026
- —
- November 14, 2026
- —
- November 15, 2026
- —
Completed days come from GitHub star history; today and forecasts are excluded from this comparison. History checked: September 29, 2026, 00:16 UTC. Sources and measurement limits →
Three GitHub discoveries in each edition
What they do, why they are gaining interest, and what to check before using them.
Editions at 10:00, 16:00, 22:00 MSK.
Numbers
- Total stars
- 182
- Today
- Not enough measurements today
- Forks
- 16
- Issues and pull requests
- 1
- Watchers
- 2
- Language
- Python
- License
- Apache-2.0
- Created
- September 19, 2026
- Last push
- September 21, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 25, 2026Top new repositories this week: #90
- September 24, 2026Top new repositories this week: #105
- September 23, 2026Top new repositories this week: #101
- September 22, 2026Top new repositories this week: #100
- September 21, 2026Top new repositories this week: #116