PrismML-Eng/Bonsai-demo

Bonsai Demo

Language modelsShell#bonsai#llm#prism-ml#llamacpp#mlx

1.7 Cooling Magnitude out of 10 — how fast interest is growing, not a quality score. Star growth looks organic. Data as of September 29, 2026, 12:30 UTC.

Open on Seismograph Open on GitHub

About the project

Demo scripts for running the ternary Bonsai 2 27B model (5.9 GB) locally via a llama.cpp fork or MLX: chat, vision, tool calling and 262K context on a laptop or single GPU.

Useful for

Run a local Bonsai 2 27B chat on Mac or Linux with a single setup.sh command
Send a screenshot or PDF to the model and ask about its contents
Wire up MCP servers and OpenAI-style tool_calls for agentic workflows

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.

Why it’s trending

9 stars so far today, about 18 expected by the end of the day.
Interest is fading: the two-day pace is 25% of the previous week and a half.
GitHub Trending this week: #16, +243 stars.

Stars per day

Bars are daily stars, the line is the usual pace. Red marks spike days.

Numbers

Total stars: 3,194
Today: 9 · ≈ 18 by evening
Forks: 347
Issues and pull requests: 245
Watchers: 30
Language: Shell
License: Apache-2.0
Created: March 25, 2026
Last push: September 28, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in

September 29, 2026GitHub Trending this week: #16, +243 stars

README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

[![Seismograph](https://gitnova.dev/badge/PrismML-Eng/Bonsai-demo.svg?lang=en)](https://gitnova.dev/en/r/PrismML-Eng/Bonsai-demo)

More in this category

8.2
firelex/jeff
Small fine-tuned Qwen3.5 and Gemma 4 models for zero-shot classification: given a situation description and a list of options, they return a calibrated probability for each option in a single forward pass.

Early signalLanguage modelsPython+219 stars today, ≈ 466 by evening
7.4
VectifyAI/PageIndex
A vectorless RAG engine that builds a hierarchical tree index of a document and retrieves by LLM reasoning over that tree, the way a human navigates a report. Aimed at long professional PDFs such as financial, legal…

BreakoutLanguage modelsPython+225 stars today, ≈ 486 by evening
7.2
Niko1221/Strata
A C++ local inference engine that runs the 125B MoE model Qwen3.8-Flash-Next on a regular PC with one NVIDIA GPU (12-24 GB) and 64 GB RAM, exposing an OpenAI/Anthropic-compatible API on localhost.

Early signalLanguage modelsC+++144 stars today, ≈ 360 by evening
5.6
ollaya-dev/ollaya
A local runtime for decision models: pulls and serves classification and routing models behind a TypeSafe-compatible API. Like Ollama, but for models that return probabilities instead of text.

Early signalLanguage modelsRust+34 stars today, ≈ 89 by evening
5.3
PostHog/jeeves
Jeeves is a reasoning model built on Qwen3.5-9B (LoRA + pointer head), trained with SFT and CISPO, that thinks before answering and returns calibrated probabilities for yes/no, multiple-choice and rating questions via…

Early signalLanguage modelsPython+39 stars today, ≈ 58 by evening
4.9
deepfates/imp
A port of DSPy to the BEAM: declarative LM programs in Elixir with signatures, optimizers and agents running as OTP processes.

Early signalLanguage modelsElixir+1 star today, ≈ 13 by evening