mudler/LocalAI
★ 50,320GoMIT93
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
What it is
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. A small core, not a bundle. Each backend wraps a best-in-class engine (llama.cpp, vLLM, whisper.cpp, stable-diffusion, MLX...) in its own image, pulled only when a model needs it. You install nothing you don't use.
When to use it
Reach for LocalAI when you need to call, serve, run locally, fine-tune or chat with a language model — it's written in Go and fits stacks tagged ai-agents, ai, api, audio-generation.
Quick start
$ git clone https://github.com/mudler/LocalAI.git
Hand it to your AI
Read https://ideas.asveas.com/r/mudler/LocalAI.md and help me add mudler/LocalAI to my project. Explain the setup steps for my stack and show the minimal code to get it working.
