xinxuxin/keystone-bench

A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.

Language modelsPython#ai-safety#benchmark#clinical-decision-support#dataset#evaluation

3.0 Early signal Magnitude out of 10. Star growth looks organic. Data as of September 14, 2026.

Open on Seismograph Open on GitHub

About the project

A clinical chat benchmark: it tests whether an assistant's action changes when one decisive fact in a conversation is removed, replaced, or contradicted, and whether the physician rubric stays applicable.

Useful for

Test whether an assistant stays cautious when a decisive fact is removed from the question
Check whether a model overreacts to a salient but irrelevant fact in the dialogue
Compare several assistants' behaviour on the same set of clinical twin conversations

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.

Why it’s trending

53 stars today.
Over the last two days the pace is 8× that of the previous week and a half.
The spike has held for 2 days in a row — not a one-off blip.
The repository is 6 days old and already has 87 stars.
Top new repositories this week: #172.

Stars per day

Bars are daily stars, the line is the usual pace. Red marks spike days.

Numbers

Total stars: 87
Stars in a day: 54
Forks: 1
Issues and pull requests: 0
Watchers: 1
Language: Python
Latest release: v0.4.0 · September 7, 2026
Created: September 7, 2026
Last push: September 13, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in

September 13, 2026Top new repositories this week: #172

README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

[![Seismograph](https://gitnova.dev/badge/xinxuxin/keystone-bench.svg?lang=en)](https://gitnova.dev/en/r/xinxuxin/keystone-bench)

Similar projects

6.1
JustVugg/colibri
A pure-C, zero-dependency inference engine for running large MoE models (744B–2.8T parameters) on consumer hardware by treating VRAM, RAM, and storage as a single multitier hierarchy and streaming experts from disk.

BreakoutLanguage modelsC+1,048 stars in a day
5.7
asgeirtj/system_prompts_leaks
A collection of extracted system prompts from Anthropic, OpenAI, Google, xAI and others — the hidden instructions chatbots receive before a user's first message.

BreakoutLanguage modelsJavaScript+428 stars in a day
5.1
kennethwolters/litelm
A lightweight litellm alternative: routes LLM calls across 19 providers and translates message formats in ~2,900 lines with two dependencies, without proxy, caching, or cost tracking.

Early signalLanguage modelsPython+9 stars in a day
5.0
MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-Sparks
A local EXL3 2.9 bpw checkpoint of DeepSeek-V4.1-Flash (196 GiB, 39 shards) served via an OpenAI-compatible vLLM API on a 2x NVIDIA GB10 (DGX Spark) kit with tensor-parallel 2. Includes DSpark speculative decoding and…

Early signalLanguage modelsPython+81 stars in a day
4.8
unclecode/crawl4ai
Open-source web crawler and scraper that turns pages into clean, LLM-ready Markdown for RAG, agents and data pipelines. Runs via Python API, CLI and Docker with no API keys.

BreakoutLanguage modelsPython+411 stars in a day
4.5
Edge0-AI/Edge0
An open-source streaming MoE inference framework: expert weights are offloaded from SSD on demand while a trained prerouter predicts routing ahead of time. Runs on Apple Silicon via MLX and ships with two ready-to-run…

CoolingLanguage modelsPython+118 stars in a day