# mudler/LocalAI

> LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

- GitHub: https://github.com/mudler/LocalAI
- Website: https://localai.io
- Category: LLM & Inference (https://ideas.asveas.com/c/llm); also Generative Media
- Tags: ai-agents, ai, api, audio-generation, decentralized, distributed, image-generation, libp2p, llama, llm, mamba, mcp, musicgen, object-detection
- Language: Go · License: MIT
- Stars: 50,320 · Forks: 4,592 · Open issues: 185
- Last push: 2026-11-11 (today)
- Vibe score: 93/100

## What it is
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. A small core, not a bundle. Each backend wraps a best-in-class engine (llama.cpp, vLLM, whisper.cpp, stable-diffusion, MLX...) in its own image, pulled only when a model needs it. You install nothing you don't use.

## When to use it
Reach for LocalAI when you need to call, serve, run locally, fine-tune or chat with a language model — it's written in Go and fits stacks tagged ai-agents, ai, api, audio-generation.

## Maintenance
mudler/LocalAI looks very actively maintained: the last push was today (2026-11-11), with 50,320 stars and 185 open issues.

## Quick start
```bash
git clone https://github.com/mudler/LocalAI.git
```

## Alternatives in LLM & Inference
- [ollama/ollama](https://github.com/ollama/ollama) — Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (★187k, Go, vibe 99/100) · details: https://ideas.asveas.com/r/ollama/ollama
- [huggingface/transformers](https://github.com/huggingface/transformers) — 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training. (★169k, Python, vibe 98/100) · details: https://ideas.asveas.com/r/huggingface/transformers
- [open-webui/open-webui](https://github.com/open-webui/open-webui) — User-friendly AI Interface (Supports Ollama, OpenAI API, ...) (★158k, Svelte, vibe 98/100) · details: https://ideas.asveas.com/r/open-webui/open-webui
- [langflow-ai/langflow](https://github.com/langflow-ai/langflow) — Langflow is a powerful tool for building and deploying AI-powered agents and workflows. (★157k, Python, vibe 98/100) · details: https://ideas.asveas.com/r/langflow-ai/langflow
- [vllm-project/vllm](https://github.com/vllm-project/vllm) — A high-throughput and memory-efficient inference and serving engine for LLMs (★96.8k, Python, vibe 96/100) · details: https://ideas.asveas.com/r/vllm-project/vllm
- [lobehub/lobehub](https://github.com/lobehub/lobehub) — 🤯 LobeHub - Super-Agents on Your Team. Add super-agents to the chats your team already uses.They take on work by themselves and get better every week. (★85k, TypeScript, vibe 95/100) · details: https://ideas.asveas.com/r/lobehub/lobehub

---
Source: https://ideas.asveas.com/r/mudler/LocalAI · Catalog: https://ideas.asveas.com/llms.txt