Simreal-AI/MathmoBench

[Public preview] An advanced AI Benchmark for math, produced by mathmo at St John's College, Cambridge.

Language modelsPython#ai-evaluation#benchmark#combinatorics#public-preview#simreal

2.2 Early signal Magnitude out of 10 — how fast interest is growing, not a quality score. Star growth looks organic. Data as of September 27, 2026, 00:58 UTC.

Open on Seismograph Open on GitHub

About the project

MathmoBench is an open benchmark for evaluating AI combinatorial reasoning: models must return machine-checkable evidence (a witness or an impossibility certificate), graded by a deterministic verifier with no LLM judge.

Useful for

Run verify.py --run-tests to check repository integrity and validator behavior.
Generate a matching dev family and test the submission.jsonl format against it.
Build a pipeline: export agent-view, collect model answers, score deterministically with a hashed receipt.

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.

Why it’s trending

0 stars so far today, about 16 expected by the end of the day.
The spike has held for 3 days in a row — not a one-off blip.
The repository is 4 days old and already has 79 stars. With less than two weeks of history, there's no usual pace to compare the spike against yet.
Top new repositories this week: #169.

Stars per day

Bars are daily stars, the line is the usual pace. Red marks spike days.

Numbers

Total stars: 79
Today: 0 · ≈ 16 by evening
Forks: 5
Issues and pull requests: 0
Watchers: 6
Language: Python
License: Apache-2.0
Created: September 23, 2026
Last push: September 24, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in

September 27, 2026Top new repositories this week: #169

README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

[![Seismograph](https://gitnova.dev/badge/Simreal-AI/MathmoBench.svg?lang=en)](https://gitnova.dev/en/r/Simreal-AI/MathmoBench)

More in this category

7.0
ollaya-dev/ollaya
A local runtime for decision models: pulls and serves classification and routing models behind a TypeSafe-compatible API. Like Ollama, but for models that return probabilities instead of text.

Early signalLanguage modelsRust+0 stars today, ≈ 164 by evening
5.9
NVIDIA/Model-Optimizer
NVIDIA library for compressing and accelerating models: quantization, pruning, distillation, NAS and speculative decoding with export to TensorRT-LLM, vLLM, SGLang. For ML engineers preparing models for deployment.

BreakoutLanguage modelsPython+0 stars today, ≈ 192 by evening
5.6
Niko1221/Strata
A C++ local inference engine that runs the 125B MoE model Qwen3.8-Flash-Next on a regular PC with one NVIDIA GPU (12-24 GB) and 64 GB RAM, exposing an OpenAI/Anthropic-compatible API on localhost.

Early signalLanguage modelsC+++0 stars today, ≈ 128 by evening
4.6
Rizzo-AI-Academy/rizzo-flow
A local-first implementation of the Jev idea: an LLM returns typed decisions (boolean, choice, score, numeric) with probabilities in a single forward pass, without generating tokens. Compatible with the TypeSafe HTTP…

Early signalLanguage modelsPython+0 stars today, ≈ 107 by evening
4.3
Liuziyu77/Valen
A multimodal decision model built on a Qwen3.5-0.8B/2B backbone: it takes text, images and video with an instruction and returns probabilities over supplied candidates without generating answer tokens. The repo…

Early signalLanguage modelsPython+0 stars today, ≈ 62 by evening
4.3
tensorflow/tensorflow
An open source machine learning platform from Google Brain with Python and C++ APIs for training and deploying neural networks. Used by researchers and developers of ML applications.

BreakoutLanguage modelsC+++0 stars today, ≈ 126 by evening