# NVIDIA/spark-local-inference

> Flare is a local inference server for NVIDIA SM120/SM121 GPUs aimed at long conversations, coding agents and repeated tool use. It compiles models with PyTorch and serves them from a Rust runtime to use workstation memory and compute more efficiently.

- Magnitude: 1.6 out of 10 — Cooling
- Stars: 690 total · +6 stars measured 2026-10-28, 00:06–16:05 UTC, ≈ 9 by evening
- Star trust: star growth looks organic
- Category: Language models · Language: Rust · License: Apache-2.0 · Created: 2026-10-20 · Last push: 2026-10-28
- GitHub: https://github.com/NVIDIA/spark-local-inference · Page: https://gitnova.dev/en/r/NVIDIA/spark-local-inference

## Useful for

- Serve a local LLM on an NVIDIA SM120/SM121 workstation for long coding sessions
- Run repeated tool calls against a locally hosted model without a Python runtime
- Prepare and serve a supported model package with the Flare CLI

## Why it’s here

- Star-counter measurements on 2026-10-28 (UTC), 00:06–16:05: 684 → 690 stars (+6). This is the change over that interval.
- Estimated end-of-day forecast: about +9 stars, using observed gains and the previous day.
- The repository is 8 days old and already has 690 stars. With less than two weeks of history, there's no usual pace to compare the spike against yet.
- Hacker News: “Nvidia Flare Local Inference” — 5 points, 7 days ago.
- Recent forks include notable developers: @gmh5225 (1,300 followers).

## Star trust

Star growth looks organic.

Star-trust labels are heuristics based on the repository’s behavior, not a check of every stargazer.

## Numbers

- Forks: 74
- Issues and pull requests: 130
- Watchers: 3
- Average over the last week: 20 per day
- Usual pace: too little history (under two weeks)
- Stars in the last hour (measured): 0

## Stars per day, last 9 days (oldest → newest, today is partial)

2026-10-20 … 2026-10-28: 213, 342, 58, 11, 21, 18, 14, 10, 6

## Magnitude by day, last 8 days

10-21 5.8, 10-22 6.6, 10-23 4.2, 10-24 3.0, 10-25 2.9, 10-26 2.7, 10-27 2.8, 10-28 1.9

## Hacker News

- Nvidia Flare Local Inference — 5 points, 0 comments: https://news.ycombinator.com/item?id=50176267

## More in this category

1. **togg53192-cmd/jailbreaks** — 7.5 · Breakout · Language models · +1,167 stars measured 2026-10-28, 00:02–15:55 UTC, ≈ 1,686 by evening
   A collection of 31 system prompts, persona locks, and AGENTS.md files for 25+ models (Claude, Gemini, Grok, GLM, DeepSeek, Kimi, Qwen, Gemma, GPT-OSS). Intended for research on how instruction hierarchies and policy overrides affect model…
   Full card: https://gitnova.dev/en/r/togg53192-cmd/jailbreaks.md
2. **SoMarkAI/OXR** — 7.2 · Breakout · Language models · Python · +253 stars measured 2026-10-28, 03:32–15:55 UTC, ≈ 413 by evening
   OXR is an open-source document parsing model that turns PDFs and document images into Markdown or JSON with layout coordinates, recognizing 13 element types such as tables, formulas, chemical structures and code. With 1.3B parameters it…
   Full card: https://gitnova.dev/en/r/SoMarkAI/OXR.md
3. **NVIDIA/auto-ontology** — 6.1 · Early signal · Language models · Python · +145 stars measured 2026-10-28, 00:02–15:55 UTC, ≈ 212 by evening
   NVIDIA's Python framework that builds a semantic ontology graph over enterprise metadata, giving LLM agents trusted metric and entity definitions for reliable text-to-SQL.
   Full card: https://gitnova.dev/en/r/NVIDIA/auto-ontology.md
4. **lyramakesmusic/neuron-explorer** — 5.9 · Peaking · Language models · Python · +92 stars measured 2026-10-28, 00:01–15:55 UTC, ≈ 142 by evening
   A steering-first neuron explorer for Qwen3.5-4B: it pushes every MLP neuron up and down on prompts, keeps all rollouts, and lays the results out over a 3D view of the model for interpretability research.
   Full card: https://gitnova.dev/en/r/lyramakesmusic/neuron-explorer.md
5. **baidu/Unlimited-OCR** — 5.7 · Breakout · Language models · Python · +321 stars measured 2026-10-28, 00:02–15:55 UTC, ≈ 485 by evening
   Baidu's OCR model for document parsing: extracts text from single images, multi-page files and PDFs in one pass, supporting long context up to 32768 tokens.
   Full card: https://gitnova.dev/en/r/baidu/Unlimited-OCR.md

---

Magnitude (0–10) measures how fast and how unusually interest in a repository is growing right now. It is not a quality score.
Days are UTC. “So far today” is a fact; “expected by the end of the day” is a forecast.
Summaries and use cases are written by an LLM (DeepSeek V4.1 Flash) from the README and may be inaccurate: verify specific claims (benchmarks, speed, hardware) in the repository itself.
Data as of 2026-10-28 16:10 UTC, updated every 30 minutes.