lkarlslund/laya.cpp

C++ inference for Laya typed decisions - supports CUDA, Vulkan, Core ML, CPU

Language modelsC++

2.1 Early signal Magnitude out of 10 — how fast interest is growing, not a quality score. Star growth looks organic. Data as of September 24, 2026, 02:50 UTC.

Open on Seismograph Open on GitHub

About the project

Native C++ inference for Laya models with CUDA, Vulkan, and Apple Core ML backends, without Python. Supports tokenization, inference, JSON output, and an HTTP server with automatic request batching.

Useful for

Run local Laya inference on GPU without Python for processing JSON requests
Deploy an HTTP server with automatic batching to integrate Laya into existing systems
Build the project for CUDA, Vulkan, or Core ML on a specific platform

README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.

Why it’s trending

0 stars so far today, about 12 expected by the end of the day.
The spike has held for 3 days in a row — not a one-off blip.
The repository is 4 days old and already has 81 stars. With less than two weeks of history, there's no usual pace to compare the spike against yet.
Top new repositories this week: #200.

Stars per day

Bars are daily stars, the line is the usual pace. Red marks spike days.

Numbers

Total stars: 81
Today: 0 · ≈ 12 by evening
Forks: 8
Issues and pull requests: 14
Watchers: 2
Language: C++
License: MIT
Latest release: r0002 · September 23, 2026
Created: September 20, 2026
Last push: September 23, 2026

Star trust

Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.

These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.

Spotted in

September 24, 2026Top new repositories this week: #198

README badge

Paste it into your README — the badge shows the current magnitude and links to this page.

[![Seismograph](https://gitnova.dev/badge/lkarlslund/laya.cpp.svg?lang=en)](https://gitnova.dev/en/r/lkarlslund/laya.cpp)

Similar by description

0.4
navaneethkrishnansuresh/Inference-Engineering
A hands-on course on LLM inference engineering covering what happens when a model serves a request: tokenization, prefill, decode, KV cache, scheduling and batching. Aimed at developers who want to understand the…

SteadyLanguage modelsJupyter Notebook+0 stars today, ≈ 1 by evening
2.0
0xShug0/audio.cpp
A native C++ inference engine for audio models built on ggml: TTS, speech recognition, VAD, voice cloning, music generation. Runs without Python on CPU, CUDA, ROCm, Vulkan and Metal.

SteadyGenerative mediaC+++0 stars today, ≈ 24 by evening
0.9
deepseek-ai/deepseek-recipe
A collection of Rust libraries and Python bindings that convert API requests in different formats (Messages, Chat Completions, Responses) into the Conversation format, encode them into prompts for DeepSeek V4/V4.1…

SteadyLanguage modelsRust+0 stars today, ≈ 1 by evening
1.6
paradigma-inc/limite-violetto
Repository provides a vLLM plugin for serving Limite 1B — Violetto, a model trained to solve difficult mathematical problems one at a time. Weights and tokenizer are hosted on Hugging Face.

CoolingLanguage modelsPython+0 stars today, ≈ 7 by evening
2.6
bojieli/ai-infra-book
Open book "Understanding AI Infra" by Bojie Li: quantitative derivation of LLM inference and training system design from hardware constraints and model architecture. Includes full text, PDF, calculation tools and…

CoolingLearning & listsPython+0 stars today, ≈ 90 by evening
2.5
huggingface/tokenizers
Hugging Face tokenization library written in Rust with Python and Node.js bindings: fast BPE, Unigram, WordPiece and WordLevel implementations for training and inference of NLP models.

BreakoutLanguage modelsRust+0 stars today, ≈ 9 by evening