mode-io/vllm-jev
Native vLLM serving for Jev decision models
About the project
A vLLM-based server for Jev decision models: given a question and candidate answers, it returns a label and probability for each candidate. Runs on Linux with NVIDIA GPUs and on Apple Silicon via MLX/MPS.
Useful for
- Deploy an HTTP server to classify customer intent across candidate labels
- Run local Valen inference on a Mac for image-based questions
- Handle 40 concurrent text Choice requests on a single A800
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.
Why it’s trending
- 18 stars so far today, about 29 expected by the end of the day.
- The spike has held for 3 days in a row — not a one-off blip.
- The repository is 5 days old and already has 96 stars. With less than two weeks of history, there's no usual pace to compare the spike against yet.
- Top new repositories this week: #166.
Stars per day
Bars are daily stars, the line is the usual pace. Red marks spike days.
Numbers
- Total stars
- 96
- Today
- 18 · ≈ 29 by evening
- Forks
- 2
- Issues and pull requests
- 1
- Watchers
- 1
- Language
- Python
- License
- Apache-2.0
- Created
- September 24, 2026
- Last push
- September 27, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 29, 2026Top new repositories this week: #166
Share
README badge
Paste it into your README — the badge shows the current magnitude and links to this page.
[](https://gitnova.dev/en/r/mode-io/vllm-jev)Similar by description
-
8.2
firelex/jeff
Small fine-tuned Qwen3.5 and Gemma 4 models for zero-shot classification: given a situation description and a list of options, they return a calibrated probability for each option in a single forward pass.
-
4.3
Liuziyu77/Valen
A multimodal decision model built on a Qwen3.5-0.8B/2B backbone: it takes text, images and video with an instruction and returns probabilities over supplied candidates without generating answer tokens. The repo…
-
0.6
ekzhang/openjev-sglang
HTTP server implementing the TypeSafe/Jev API for structured text classification on Qwen3.6-35B-A3B via SGLang; returns answer probabilities without generating a chain of thought.
-
1.8
bespokelabsai/nimble
Nimble is a model and training recipe for fast typed decisions over text: given a flat schema of enum and boolean fields, it picks an answer and returns probabilities for each option. It targets routing, condition…
-
0.6
zhulinchng/jevper
A classification wrapper over OpenAI-compatible clients: instead of prose it returns typed questions (noul, choice, score) with probabilities and confidence. Works with any client exposing responses.create or…
-
0.8
kshetrajna12/reflex
An open decision model: given a state (text, JSON, or image) and typed questions, it returns calibrated probabilities over fixed answer options. Runs on top of Qwen3.5 and answers with numbers instead of free text.