Multi-provider gateway
One data plane in front of every major LLM provider, speaking both the OpenAI and Anthropic wire formats.
- Dispatches to OpenAI, Anthropic, Google Gemini, xAI, AWS Bedrock, local Ollama, and self-hosted llama.cpp.
- OpenAI-compatible POST /v1/chat/completions and Anthropic-compatible POST /v1/messages (plus /v1/messages/count_tokens) on the same base URL.
- GET /v1/models lists every configured model across providers; streaming via Server-Sent Events for both wire formats.