# ggml-org/llama.cpp

> LLM inference in C/C++

- GitHub: https://github.com/ggml-org/llama.cpp
- Website: https://llama.app
- Category: LLM & Inference (https://ideas.asveas.com/c/llm)
- Tags: ggml, llm, cpp
- Language: C++ · License: MIT
- Stars: 134,082 · Forks: 25,405 · Open issues: 2,600
- Last push: 2026-11-11 (today)
- Vibe score: 93/100

## What it is
ggml / ops / maintainer PRs%20sort%3Aupdated-desc) / dev stats / lib llama API / llama-server REST API Visit https://llama.app and follow the instructions Run with Docker - see our Docker documentation Download pre-built binaries from the releases page Build from source by cloning this repository - check out our build guide

## When to use it
Reach for llama.cpp when you need to call, serve, run locally, fine-tune or chat with a language model — it's written in C++ and fits stacks tagged ggml, llm, cpp.

## Maintenance
ggml-org/llama.cpp looks very actively maintained: the last push was today (2026-11-11), with 134,082 stars and 2,600 open issues.

## Quick start
```bash
git clone https://github.com/ggml-org/llama.cpp.git
```

## Alternatives in LLM & Inference
- [ollama/ollama](https://github.com/ollama/ollama) — Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (★187k, Go, vibe 99/100) · details: https://ideas.asveas.com/r/ollama/ollama
- [huggingface/transformers](https://github.com/huggingface/transformers) — 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training. (★169k, Python, vibe 98/100) · details: https://ideas.asveas.com/r/huggingface/transformers
- [open-webui/open-webui](https://github.com/open-webui/open-webui) — User-friendly AI Interface (Supports Ollama, OpenAI API, ...) (★158k, Svelte, vibe 98/100) · details: https://ideas.asveas.com/r/open-webui/open-webui
- [langflow-ai/langflow](https://github.com/langflow-ai/langflow) — Langflow is a powerful tool for building and deploying AI-powered agents and workflows. (★157k, Python, vibe 98/100) · details: https://ideas.asveas.com/r/langflow-ai/langflow
- [vllm-project/vllm](https://github.com/vllm-project/vllm) — A high-throughput and memory-efficient inference and serving engine for LLMs (★96.8k, Python, vibe 96/100) · details: https://ideas.asveas.com/r/vllm-project/vllm
- [lobehub/lobehub](https://github.com/lobehub/lobehub) — 🤯 LobeHub - Super-Agents on Your Team. Add super-agents to the chats your team already uses.They take on work by themselves and get better every week. (★85k, TypeScript, vibe 95/100) · details: https://ideas.asveas.com/r/lobehub/lobehub

---
Source: https://ideas.asveas.com/r/ggml-org/llama.cpp · Catalog: https://ideas.asveas.com/llms.txt