# mudler/LocalAI

> LocalAI is an open-source AI engine that runs LLMs, vision, voice, image and video models on any hardware, including CPU-only, behind an OpenAI-compatible API.

- Magnitude: 1.8 out of 10 — Steady
- Stars: 49,290 total · +6 stars today, ≈ 10 by evening
- Star trust: star growth looks organic
- Category: Language models · Language: Go · License: MIT · Created: 2023-03-18 · Last push: 2026-09-27
- GitHub: https://github.com/mudler/LocalAI · Homepage: https://localai.io · Page: https://gitnova.dev/en/r/mudler/LocalAI

## Useful for

- Deploy a local OpenAI-compatible LLM API in Docker without a GPU
- Run a private chat assistant with RAG and MCP over your own data
- Host an image generation and TTS server with API-key access control

## Why it’s here

- 6 stars so far today, about 10 expected by the end of the day.
- GitHub Trending Go today: #14, +22 stars.

## Star trust

Star growth looks organic.

Star-trust labels are heuristics based on the repository’s behavior, not a check of every stargazer.

## Numbers

- Forks: 4,473
- Issues and pull requests: 7,674
- Watchers: 299
- Average over the last week: 16 per day
- Usual pace: 21 per day
- Stars in the last hour (measured): 1
- Latest release: v4.10.0 (2026-09-17)

## Stars per day, last 30 days (oldest → newest, today is partial)

2026-08-29 … 2026-09-27: 30, 22, 25, 25, 18, 19, 21, 27, 60, 27, 30, 25, 30, 20, 34, 18, 11, 14, 13, 16, 20, 17, 23, 12, 22, 22, 13, 14, 21, 6

## Spotted in now

- GitHub Trending Go today: #14, +22 stars

## Similar by description

1. **techjarves/Portable-Local-Studio** — 1.3 · Steady · Apps · JavaScript · +5 stars today, ≈ 7 by evening
   Offline local AI studio for Windows, Linux and macOS with a zero-setup GUI: image generation (Stable Diffusion), GGUF LLM chat, speech-to-text (Whisper) and text-to-speech (Kokoro TTS).
   Full card: https://gitnova.dev/en/r/techjarves/Portable-Local-Studio.md
2. **EricLBuehler/mistral.rs** — 0.6 · Steady · Language models · Rust · +0 stars today, ≈ 0 by evening
   A Rust LLM inference engine with automatic model loading, multimodality (text, image, video, audio), quantization, and an OpenAI/Anthropic-compatible server.
   Full card: https://gitnova.dev/en/r/EricLBuehler/mistral.rs.md
3. **AtomicBot-ai/Atomic-Chat** — 1.2 · Steady · Language models · TypeScript · +3 stars today, ≈ 5 by evening
   Desktop app and local inference engine for running open-weight LLMs (Llama, Gemma, Qwen, Mistral, etc.) on your own machine, exposing an OpenAI-compatible API at localhost:1337/v1.
   Full card: https://gitnova.dev/en/r/AtomicBot-ai/Atomic-Chat.md
4. **mostlygeek/llama-swap** — 1.1 · Steady · Language models · Go · +2 stars today, ≈ 3 by evening
   A Go proxy server that runs multiple local models and hot-swaps between them on demand, compatible with OpenAI and Anthropic APIs. Works with llama.cpp, vllm, stable-diffusion.cpp and other backends.
   Full card: https://gitnova.dev/en/r/mostlygeek/llama-swap.md

---

Magnitude (0–10) measures how fast and how unusually interest in a repository is growing right now. It is not a quality score.
Days are UTC. “So far today” is a fact; “expected by the end of the day” is a forecast.
Summaries and use cases are written by an LLM (DeepSeek V4.1 Flash) from the README and may be inaccurate: verify specific claims (benchmarks, speed, hardware) in the repository itself.
Data as of 2026-09-27 16:22 UTC, updated every 30 minutes.