fstandhartinger/jevbench

JevBench v1 - a benchmark for Jev-class typed decision models: smart, cheap, fast, reliable, open.

Language modelsPython

2.4 Early signal Magnitude out of 10 — how fast interest is growing, not a quality score. Star growth looks organic. Data as of September 24, 2026, 02:50 UTC.

Open on Seismograph Open on GitHub

About the project

A benchmark for Jev-class decision models: the model receives state and a rubric, returns a typed answer with probabilities. It scores accuracy, calibration, speed, and cost.

Useful for

Compare your decision model against Jev 1.13.0 and others on a single scale
Check probability calibration of a model on the 220-task hard set
Estimate cost and latency per 1000 decisions to choose between API and self-hosted

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.

Why it’s trending

0 stars so far today, about 17 expected by the end of the day.
The spike has held for 3 days in a row — not a one-off blip.
The repository is 5 days old and already has 106 stars. With less than two weeks of history, there's no usual pace to compare the spike against yet.
Top new repositories this week: #160.

Stars per day

Bars are daily stars, the line is the usual pace. Red marks spike days.

Numbers

Total stars: 106
Today: 0 · ≈ 17 by evening
Forks: 11
Issues and pull requests: 65
Watchers: 1
Language: Python
License: MIT
Latest release: v1.4.1 · September 23, 2026
Created: September 19, 2026
Last push: September 23, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in

September 24, 2026Top new repositories this week: #158

README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

[![Seismograph](https://gitnova.dev/badge/fstandhartinger/jevbench.svg?lang=en)](https://gitnova.dev/en/r/fstandhartinger/jevbench)

Similar by description

4.2
receptron/laya
TypeScript wrapper for running the open-source Laya System-1 decision model via ONNX Runtime: takes a state and typed questions, returns answers with calibrated probabilities in one forward pass.

Early signalLanguage modelsTypeScript+0 stars today, ≈ 47 by evening
5.6
mizorewww/laya-mlx
Native MLX runtime for Laya typed decision models: returns probabilities for choices, scores or truth values without text generation, running locally on Apple Silicon.

CoolingLanguage modelsPython+0 stars today, ≈ 279 by evening
2.6
kraayenjon/awesome-jev
A curated list of resources for Jev, TypeSafe AI's System One model that returns typed decisions (Choice, Score, Noul) with calibrated probabilities instead of generated text. Aimed at developers integrating Jev into…

Early signalLearning & lists+0 stars today, ≈ 10 by evening
4.0
mizorewww/laya-coreml
Local port of the Laya model to Apple Core ML and Neural Engine: returns typed decisions (choice, score, yes/no) without token generation, with speed and energy benchmarks.

CoolingLanguage modelsPython+0 stars today, ≈ 57 by evening
4.0
Zefan-Cai/Open-Jev
Open-Jev serves a context, questions and candidate answers to Qwen-based models and returns typed probabilities directly, without autoregressive generation or JSON parsing. It provides LoRA adapters, a scalar decision…

Early signalLanguage modelsPython+0 stars today, ≈ 47 by evening
2.5
Mapika/decider
A language model that does not generate text: from a single forward pass it returns calibrated probabilities for typed questions (Choice, Score, Noul) about a given state. An open reproduction of the "System One" model…

CoolingLanguage modelsPython+0 stars today, ≈ 14 by evening