# LLM & Inference — open-source repos for vibecoders

> SDKs, local runtimes, gateways, chat UIs and fine-tuning kits for large language models. Use these when you need to call, serve, run locally, fine-tune or chat with a language model.

- [ollama/ollama](https://github.com/ollama/ollama) — Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. (★187k, Go, vibe 99/100) · details: https://ideas.asveas.com/r/ollama/ollama
- [huggingface/transformers](https://github.com/huggingface/transformers) — 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training. (★169k, Python, vibe 98/100) · details: https://ideas.asveas.com/r/huggingface/transformers
- [open-webui/open-webui](https://github.com/open-webui/open-webui) — User-friendly AI Interface (Supports Ollama, OpenAI API, ...) (★158k, Svelte, vibe 98/100) · details: https://ideas.asveas.com/r/open-webui/open-webui
- [langflow-ai/langflow](https://github.com/langflow-ai/langflow) — Langflow is a powerful tool for building and deploying AI-powered agents and workflows. (★157k, Python, vibe 98/100) · details: https://ideas.asveas.com/r/langflow-ai/langflow
- [vllm-project/vllm](https://github.com/vllm-project/vllm) — A high-throughput and memory-efficient inference and serving engine for LLMs (★96.8k, Python, vibe 96/100) · details: https://ideas.asveas.com/r/vllm-project/vllm
- [lobehub/lobehub](https://github.com/lobehub/lobehub) — 🤯 LobeHub - Super-Agents on Your Team. Add super-agents to the chats your team already uses.They take on work by themselves and get better every week. (★85k, TypeScript, vibe 95/100) · details: https://ideas.asveas.com/r/lobehub/lobehub
- [unslothai/unsloth](https://github.com/unslothai/unsloth) — Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more. (★79.3k, Python, vibe 95/100) · details: https://ideas.asveas.com/r/unslothai/unsloth
- [BerriAI/litellm](https://github.com/BerriAI/litellm) — The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] (★63.1k, Python, vibe 94/100) · details: https://ideas.asveas.com/r/BerriAI/litellm
- [ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp) — LLM inference in C/C++ (★134k, C++, vibe 93/100) · details: https://ideas.asveas.com/r/ggml-org/llama.cpp
- [mudler/LocalAI](https://github.com/mudler/LocalAI) — LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. (★50.3k, Go, vibe 93/100) · details: https://ideas.asveas.com/r/mudler/LocalAI
- [vercel/ai](https://github.com/vercel/ai) — The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents (★27.9k, TypeScript, vibe 90/100) · details: https://ideas.asveas.com/r/vercel/ai
- [openai/openai-node](https://github.com/openai/openai-node) — Official JavaScript / TypeScript library for the OpenAI API (★11.3k, TypeScript, vibe 86/100) · details: https://ideas.asveas.com/r/openai/openai-node
- [anthropics/anthropic-sdk-typescript](https://github.com/anthropics/anthropic-sdk-typescript) — Access to Anthropic's safety-first language model APIs in TypeScript (★2.2k, TypeScript, vibe 74/100) · details: https://ideas.asveas.com/r/anthropics/anthropic-sdk-typescript
- [anthropics/anthropic-sdk-python](https://github.com/anthropics/anthropic-sdk-python) — No description. (★4.1k, Python, vibe 73/100) · details: https://ideas.asveas.com/r/anthropics/anthropic-sdk-python
- [Significant-Gravitas/AutoGPT](https://github.com/Significant-Gravitas/AutoGPT) — AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters. (★188k, Python, vibe 99/100) · details: https://ideas.asveas.com/r/Significant-Gravitas/AutoGPT
- [langchain-ai/langchain](https://github.com/langchain-ai/langchain) — The agent engineering platform. (★149k, Python, vibe 98/100) · details: https://ideas.asveas.com/r/langchain-ai/langchain
- [OpenHands/OpenHands](https://github.com/OpenHands/OpenHands) — 🙌 OpenHands: AI-Driven Development (★93.2k, TypeScript, vibe 95/100) · details: https://ideas.asveas.com/r/OpenHands/OpenHands
- [openai/openai-cookbook](https://github.com/openai/openai-cookbook) — Examples and guides for using the OpenAI API (★77k, Jupyter Notebook, vibe 95/100) · details: https://ideas.asveas.com/r/openai/openai-cookbook
- [run-llama/llama_index](https://github.com/run-llama/llama_index) — LlamaIndex is the document processing platform for AI (★52.9k, Python, vibe 93/100) · details: https://ideas.asveas.com/r/run-llama/llama_index
- [colinhacks/zod](https://github.com/colinhacks/zod) — TypeScript-first schema validation with static type inference (★44.3k, TypeScript, vibe 92/100) · details: https://ideas.asveas.com/r/colinhacks/zod
- [openai/openai-agents-python](https://github.com/openai/openai-agents-python) — A lightweight, powerful framework for multi-agent workflows (★30.6k, Python, vibe 90/100) · details: https://ideas.asveas.com/r/openai/openai-agents-python
- [e2b-dev/E2B](https://github.com/e2b-dev/E2B) — Open-source, secure environment with real-world tools for enterprise-grade agents. (★14.8k, Python, vibe 87/100) · details: https://ideas.asveas.com/r/e2b-dev/E2B
- [huggingface/smolagents](https://github.com/huggingface/smolagents) — 🤗 smolagents: a barebones library for agents that think in code. (★30.3k, Python, vibe 86/100) · details: https://ideas.asveas.com/r/huggingface/smolagents
- [anthropics/claude-cookbooks](https://github.com/anthropics/claude-cookbooks) — A collection of notebooks/recipes showcasing some fun and effective ways of using Claude. (★54.5k, Jupyter Notebook, vibe 85/100) · details: https://ideas.asveas.com/r/anthropics/claude-cookbooks
- [vercel/chatbot](https://github.com/vercel/chatbot) — A full-featured, hackable Next.js AI chatbot built by Vercel (★21k, TypeScript, vibe 84/100) · details: https://ideas.asveas.com/r/vercel/chatbot
- [Aider-AI/aider](https://github.com/Aider-AI/aider) — aider is AI pair programming in your terminal (★50.1k, Python, vibe 74/100) · details: https://ideas.asveas.com/r/Aider-AI/aider
- [stackblitz/bolt.new](https://github.com/stackblitz/bolt.new) — Prompt, run, edit, and deploy full-stack web applications. -- bolt.new -- Help Center: https://support.bolt.new/ -- Community Support: https://discord.com/invite/stackblitz (★16.6k, TypeScript, vibe 63/100) · details: https://ideas.asveas.com/r/stackblitz/bolt.new

---
Source: https://ideas.asveas.com/c/llm · 27 repositories · Catalog: https://ideas.asveas.com/llms.txt