# BerriAI/litellm

> The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

- GitHub: https://github.com/BerriAI/litellm
- Website: https://docs.litellm.ai/docs/
- Category: LLM & Inference (https://ideas.asveas.com/c/llm)
- Tags: ai-gateway, anthropic, azure-openai, bedrock, gateway, langchain, litellm, llm, llm-gateway, llmops, mcp-gateway, openai, openai-proxy, rust
- Language: Python · License: Other
- Stars: 63,113 · Forks: 13,199 · Open issues: 5,141
- Last push: 2026-11-11 (today)
- Vibe score: 94/100

## What it is
Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format. LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format.

## When to use it
Reach for litellm when you need to call, serve, run locally, fine-tune or chat with a language model — it's written in Python and fits stacks tagged ai-gateway, anthropic, azure-openai, bedrock.

## Maintenance
BerriAI/litellm looks very actively maintained: the last push was today (2026-11-11), with 63,113 stars and 5,141 open issues.

## Quick start
```bash
git clone https://github.com/BerriAI/litellm.git
```

## Alternatives in LLM & Inference
- [ollama/ollama](https://github.com/ollama/ollama) — Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (★187k, Go, vibe 99/100) · details: https://ideas.asveas.com/r/ollama/ollama
- [huggingface/transformers](https://github.com/huggingface/transformers) — 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training. (★169k, Python, vibe 98/100) · details: https://ideas.asveas.com/r/huggingface/transformers
- [open-webui/open-webui](https://github.com/open-webui/open-webui) — User-friendly AI Interface (Supports Ollama, OpenAI API, ...) (★158k, Svelte, vibe 98/100) · details: https://ideas.asveas.com/r/open-webui/open-webui
- [langflow-ai/langflow](https://github.com/langflow-ai/langflow) — Langflow is a powerful tool for building and deploying AI-powered agents and workflows. (★157k, Python, vibe 98/100) · details: https://ideas.asveas.com/r/langflow-ai/langflow
- [vllm-project/vllm](https://github.com/vllm-project/vllm) — A high-throughput and memory-efficient inference and serving engine for LLMs (★96.8k, Python, vibe 96/100) · details: https://ideas.asveas.com/r/vllm-project/vllm
- [lobehub/lobehub](https://github.com/lobehub/lobehub) — 🤯 LobeHub - Super-Agents on Your Team. Add super-agents to the chats your team already uses.They take on work by themselves and get better every week. (★85k, TypeScript, vibe 95/100) · details: https://ideas.asveas.com/r/lobehub/lobehub

---
Source: https://ideas.asveas.com/r/BerriAI/litellm · Catalog: https://ideas.asveas.com/llms.txt