BerriAI/litellmGitHub searchdetected · 100% confidence
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Endpoint health
unknown- Last checked
- No observation yet
- Latency
- Unknown
- Consecutive failures
- 0
Machine-readable profile
mcp-server · schema v1 · package or metadata only
mcp-server:BerriAI%2Flitellm