Antirion

Antirion sits between your apps and every LLM provider, and it is built to never be the slow part. One Rust binary with the console built in: point any OpenAI or Anthropic SDK at it and get fallbacks across providers, budgets per team and key, PII and secrets redaction, caching, and a log of every request with its route and cost. On 4 vCPUs it adds 0.5 ms at 5,000 RPS and holds 14,000 RPS, 4x Bifrost. Open source and self-hosted.