i ideas / repo launcher
unslothai avatar

unslothai/unsloth

★ 79,327PythonApache-2.095

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

What it is

The Unsloth Docker image unsloth/unsloth is available on Docker. Read guide. Unsloth works on Windows, Linux, WSL and macOS. We support Multi GPU setups, NVIDIA, AMD, Intel GPUs, CPUs and the Vulkan backend. Run and train LLMs, MLX, GGUF, diffusion, decision, embedding, audio models: Qwen3.8, GLM-5.3-Flash, Kimi K3, Qwen-Image-2.1, MiniMax-H3, DeepSeek-V4, Gemma 4. Agents & Tools:** Use local models with Claude Code, Codex, and MCP, including tool calling and code execution. Browser use:** Navigate sites, fill out forms, read PDFs, and edit files beside your chat with a local model. Sandboxing:** Restrict which files your model can access when it runs commands in a sandbox. Search & RAG:**…

When to use it

Reach for unsloth when you need to call, serve, run locally, fine-tune or chat with a language model — it's written in Python and fits stacks tagged ai-agents, ai, chatgpt, deepseek.

Category
LLM & Inference
Also in
Generative Media
Stars
79,327
Forks
7,385
Last push
today
Created
2023-11-29
Open issues
504
Website
unsloth.ai/docs

Quick start

$ git clone https://github.com/unslothai/unsloth.git

Hand it to your AI

Read https://ideas.asveas.com/r/unslothai/unsloth.md and help me add unslothai/unsloth to my project. Explain the setup steps for my stack and show the minimal code to get it working.

Alternatives to unsloth

All LLM & Inference →

Pairs well with

FAQ

What is unsloth?

unslothai/unsloth is a LLM tool on GitHub: Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more. The Unsloth Docker image unsloth/unsloth is available on Docker.

When should I use unsloth?

Reach for unsloth when you need to call, serve, run locally, fine-tune or chat with a language model — it's written in Python and fits stacks tagged ai-agents, ai, chatgpt, deepseek.

What are the best alternatives to unsloth?

Popular alternatives in LLM & Inference: ollama/ollama (187k★), huggingface/transformers (169k★), open-webui/open-webui (158k★), langflow-ai/langflow (157k★), vllm-project/vllm (96.8k★).

Is unsloth actively maintained?

unslothai/unsloth looks very actively maintained: the last push was today (2026-11-11), with 79,327 stars and 504 open issues.

What license does unsloth use?

unslothai/unsloth is published under the Apache-2.0 license. Check the repository's LICENSE file before commercial use.