GitHub repo

maximhq/bifrost

Go Tracked since 2025-03-19 Updated 2026-07-16 View source ↗

#274 of 783 by Stars among GitHub repos

6.5k Stars

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

About

Bifrost is a high-performance AI gateway that unifies access to 23+ providers (OpenAI, Anthropic, AWS Bedrock, Google Vertex, and more) through a single OpenAI-compatible API. Deploy in seconds with zero configuration and get automatic failover, load balancing, semantic caching, and enterprise-grade features.

Go from zero to production-ready AI gateway in under a minute.

That's it! Your AI gateway is running with a web interface for visual configuration, real-time monitoring, and analytics.

Bifrost supports enterprise-grade, private deployments for teams running production AI systems at scale. In addition to private networking, custom security controls, and governance, enterprise…

Excerpted from github.com/maximhq/bifrost

Latest metrics

Stars 6.5k 2026-07-16
Forks 895 2026-07-16
Commits 5.7k 2026-07-16
Releases 1.0k 2026-07-16
Watchers 26 2026-07-16
Open issues 283 2026-07-16
Open PRs 353 2026-07-16