i ideas / repo launcher

RAG, Search & Data

Vector databases, search engines, crawlers and document parsers that feed knowledge to AI.
17

Use these when you need semantic search, embeddings, scraping or turning documents into LLM-ready data.

#ai-agents 8#ai 7#llm 7#rag 7#python 4#nearest-neighbor-search 4#markdown 3#database 3#hybrid-search 3#search 3#search-engine 3#hnsw 3#image-search 3#ai-search 2#crawler 2#data-extraction 2
Ranked by vibe score
firecrawl avatarfirecrawlSupercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥#1★ 201kinfiniflow avatarragflowRAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.#2★ 94kunclecode avatarcrawl4aiOfficial Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.#3★ 87.2kdocling-project avatardoclingGet your documents ready for gen AI#4★ 70.4kmem0ai avatarmem0The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.#5★ 68.8kmeilisearch avatarmeilisearchA lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.#6★ 59.8krun-llama avatarllama_indexLlamaIndex is the document processing platform for AI#7★ 52.9kmilvus-io avatarmilvusMilvus is a high-performance, cloud-native vector database built for scalable vector ANN search#8★ 46.6kqdrant avatarqdrantQdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/#9★ 35.5kchroma-core avatarchromaSearch infrastructure for AI#10★ 29.7ktypesense avatartypesenseOpen Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences#11★ 27.1kweaviate avatarweaviateWeaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.#12★ 16.9kpgvector avatarpgvectorOpen-source vector similarity search for Postgres#13★ 23.6k
Also useful here
Shubhamsaboo avatarawesome-llm-apps100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.★ 144kredis avatarredisFor developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.★ 77.4kanthropics avatarclaude-cookbooksA collection of notebooks/recipes showcasing some fun and effective ways of using Claude.★ 54.5kdair-ai avatarPrompt-Engineering-Guide🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.★ 80k
Ask your AI: ideas.asveas.com/c/rag.mdMarkdown .md
What are the best rag, search & data repositories?

By vibe score (popularity, freshness and hygiene), the top RAG, Search & Data picks are firecrawl/firecrawl (201k★), infiniflow/ragflow (94k★), unclecode/crawl4ai (87.2k★), docling-project/docling (70.4k★), mem0ai/mem0 (68.8k★).

When do I need rag, search & data?

Use these when you need semantic search, embeddings, scraping or turning documents into LLM-ready data.