magnitudedev/magnitude

Open source inference engine optimized for consumer hardware. Profiles your machine, recommends the best models for it, then downloads, tunes, and runs them. Works on Apple Silicon, NVIDIA, AMD, or nothing but a CPU.

Language modelsTypeScript

1.8 Cooling Magnitude out of 10. Star growth looks organic. Data as of September 21, 2026.

Open on Seismograph Open on GitHub

About the project

Open source inference engine for consumer hardware that profiles your machine, recommends the best local models, then downloads, tunes, and runs them, with one-click connection to AI agents.

Useful for

Discover which local models your hardware can run by profiling it before downloading
Download and run a recommended model offline and connect Claude Code or Cline in one click
Compare estimated tok/s for models and quants to pick the fastest one that fits your memory

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.

Why it’s trending

9 stars so far today, about 18 expected by the end of the day.
Interest is fading: the two-day pace is 35% of the previous week and a half.
GitHub Trending this month: #12, +3,298 stars.

Stars per day

Bars are daily stars, the line is the usual pace. Red marks spike days.

Numbers

Total stars: 4,740
Stars in a day: 18
Forks: 367
Issues and pull requests: 117
Watchers: 20
Language: TypeScript
License: Apache-2.0
Latest release: @magnitudedev/[email protected] · September 18, 2026
Created: June 12, 2026
Last push: September 20, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in

September 21, 2026GitHub Trending this month: #12, +3,298 stars

README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

[![Seismograph](https://gitnova.dev/badge/magnitudedev/magnitude.svg?lang=en)](https://gitnova.dev/en/r/magnitudedev/magnitude)

Similar projects

9.1
mizorewww/laya-mlx
Native MLX runtime for Laya typed decision models: returns probabilities for choices, scores or truth values without text generation, running locally on Apple Silicon.

BreakoutLanguage modelsPython+1,166 stars in a day
8.3
jaredpalmer/kev
kev is a LoRA adapter with a small readout head on top of Qwen2.5-0.5B that answers many typed questions about a document in a single forward pass, returning calibrated probabilities instead of text.

BreakoutLanguage modelsPython+823 stars in a day
7.2
mizorewww/laya-coreml
Local port of the Laya model to Apple Core ML and Neural Engine: returns typed decisions (choice, score, yes/no) without token generation, with speed and energy benchmarks.

Early signalLanguage modelsPython+301 stars in a day
7.2
bespokelabsai/nimble
Nimble is a model and training recipe for fast typed decisions over text: given a flat schema of enum and boolean fields, it picks an answer and returns probabilities for each option. It targets routing, condition…

Early signalLanguage modelsPython+327 stars in a day
7.1
TheoLeeCJ/SemIf
An open reproduction of the Jev-style semantic decision interface: reads typed option probabilities directly from a 4B model's logits without generating text. Runs on a single RTX 3090.

PeakingLanguage modelsPython+438 stars in a day
7.0
FareedKhan-dev/train-llm-from-scratch
Educational project: a from-scratch PyTorch Transformer plus a full LLM training pipeline — from raw text through SFT, reward modeling, PPO/DPO/GRPO to chat, without transformers, trl or peft.

BreakoutLanguage modelsPython+276 stars in a day