maximhq/bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
About the project
High-performance Go AI gateway that unifies 23+ LLM providers (OpenAI, Anthropic, Bedrock, etc.) behind a single OpenAI-compatible API with fallbacks, load balancing, and semantic caching.
Useful for
- Point the OpenAI SDK base_url at the local gateway without code changes
- Configure automatic failover between providers when one goes down
- Attach MCP tools to models through the gateway's unified interface
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate.
Why it’s trending
- 14 stars so far today, about 27 expected by the end of the day.
- GitHub Trending Go today: #21, +34 stars.
- About 11 forks a day — people are taking the code.
Stars per day
Bars are daily stars, the line is the usual pace. Red marks spike days.
Numbers
- Total stars
- 8,271
- Today
- 14 · ≈ 27 by evening
- Forks
- 1,269
- Issues and pull requests
- 7,395
- Watchers
- 33
- Language
- Go
- License
- Apache-2.0
- Latest release
- helm-chart-v2.1.43 · September 23, 2026
- Created
- March 19, 2025
- Last push
- September 23, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 23, 2026GitHub Trending Go today: #21, +34 stars
Similar by description
-
1.6
looplj/axonhub
Open-source AI gateway that lets you call 100+ LLMs through any SDK (OpenAI, Anthropic, Gemini) with zero code changes, plus failover, load balancing, cost control and end-to-end request tracing.
-
2.1
tbphp/gpt-load
Self-hosted AI gateway that unifies multiple channels and credentials (API keys and subscriptions) behind a single entry point with scheduling, failover, and request logs.
-
3.3
QuantumNous/new-api
Self-hosted AI gateway that aggregates multiple LLM providers behind a unified OpenAI-, Claude-, or Gemini-compatible API with routing, access, and cost management.
-
2.5
linguo2625469/workbuddy2api-panel
Self-hosted OpenAI-compatible gateway that turns Tencent CodeBuddy accounts into a unified /v1/chat/completions API with account pooling, rotation, cooldowns and a web admin panel.
-
3.4
Wei-Shaw/sub2api
An API gateway for AI subscription services that unifies access to Claude, OpenAI, Gemini and Grok behind one interface and lets users share subscription quotas.