litellm

by BerriAI · MCP 服务器 · ★ 50.7k

About litellm

🚅 LiteLLM Call 100+ LLMs in OpenAI format. [Bedrock, Azure, OpenAI, VertexAI, Anthropic, Groq, etc.] LiteLLM Proxy Server (AI Gateway) Enterprise Tier </

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmops

Quick Facts

Stars50,666
Forks8,941
LanguagePython
CategoryMCP 服务器
Quality Score48.092/100
Open Issues3438
Last Updated2026-06-17
Created2023-07-27
Platformsmcp, python
Est. Tokens~19k

More MCP 服务器 Tools

Explore other popular mcp 服务器 tools:

View all MCP 服务器 tools →

Popular Python Agent Tools

Frequently Asked Questions

What is litellm?

litellm is Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropi. It is categorized as a MCP 服务器 with 50.7k GitHub stars.

What programming language is litellm written in?

litellm is primarily written in Python. It covers topics such as ai-gateway, anthropic, azure-openai.

How do I install or use litellm?

You can find installation instructions and usage details in the litellm GitHub repository at github.com/BerriAI/litellm. The project has 50.7k stars and 8941 forks, indicating an active community.

View on GitHub → Browse MCP 服务器 tools