litellm

by BerriAI · MCP 服务器 · ★ 61.6k

About litellm

🚅 LiteLLM Call 100+ LLMs in OpenAI format. [Bedrock, Azure, OpenAI, VertexAI, Anthropic, Groq, etc.] LiteLLM Proxy Server (AI Gateway) Enterprise Tier Use LiteLLM for LLMs - Call 100+ LLMs (Python SDK + AI Gateway) All Supported Endpoints - , , , , , , , , and more. Python SDK AI Gateway (Proxy Server) Getting Started - E2E Tutorial - Setup virtual keys, make your first request Docs: LLM Providers Agents - Invoke A2A Agents (Python SDK + AI Gateway) Supported Providers - LangGraph, Vertex AI Agent Engine, Azure AI Foundry, Bedrock AgentCore, Pydantic AI Python SDK - A2A Protocol AI Gateway...

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmops

Quick Facts

Stars61,567
Forks12,479
LanguagePython
CategoryMCP 服务器
Quality Score63.6600777730429/100
Open Issues5584
Last Updated2026-10-19
Created2023-07-27
Platformsmcp, python
Est. Tokens~19k

More MCP 服务器 Tools

Explore other popular mcp 服务器 tools:

View all MCP 服务器 tools →

Popular Python Agent Tools

Frequently Asked Questions

What is litellm?

litellm is The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropi. It is categorized as a MCP 服务器 with 61.6k GitHub stars.

What programming language is litellm written in?

litellm is primarily written in Python. It covers topics such as ai-gateway, anthropic, azure-openai.

How do I install or use litellm?

You can find installation instructions and usage details in the litellm GitHub repository at github.com/BerriAI/litellm. The project has 61.6k stars and 12479 forks, indicating an active community.

View on GitHub → Browse MCP 服务器 tools