dchristopoulos/jev-aita
Benchmark of TypeSafe's Jev against Sonnet 5, GPT-5 nano and local LLMs on 770 Reddit AITA verdicts: Brier scores, latency and cost
About the project
A benchmark comparing TypeSafe's Jev against Sonnet 5, GPT-5 nano and local LLMs on 770 Reddit r/AmItheAsshole verdicts, measuring Brier score, latency and cost.
Useful for
- Evaluate LLM calibration and cost on a Reddit verdict prediction task
- Compare Jev latency and price against Sonnet 5 and GPT-5 nano on the same posts
- Reuse the benchmark methodology for your own model or dataset
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.
Why it’s trending
- The repository is 2 days old and already has 2 stars. With less than two weeks of history, there's no usual pace to compare the spike against yet.
- Hacker News: “Jev vs. LLMs on 770 "Am I the Asshole?" posts” — 22 points, 23 h ago.
Stars per day
Bars are daily stars, the line is the usual pace. Red marks spike days.
Numbers
- Total stars
- 2
- Today
- 0 · ≈ 0 by evening
- Forks
- 0
- Issues and pull requests
- 1
- Watchers
- 0
- Language
- Python
- Created
- September 22, 2026
- Last push
- September 23, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Hacker News discussions
- Jev vs. LLMs on 770 "Am I the Asshole?" posts22 points, September 23, 2026
Spotted in
- September 24, 2026Spotted on Hacker News
Share
README badge
Paste it into your README — the badge shows the current magnitude and links to this page.
[](https://gitnova.dev/en/r/dchristopoulos/jev-aita)Similar by description
-
2.4
fstandhartinger/jevbench
A benchmark for Jev-class decision models: the model receives state and a rubric, returns a typed answer with probabilities. It scores accuracy, calibration, speed, and cost.
-
0.1
vinilana/jev-eval-agent
A research personal-assistant agent built with eve (Vercel) using 100 mocked tools via OpenRouter, comparing LLM tool selection against the Jev classifier by number of steps.