Best Self-Hosted Vector database Tools
A vector database stores embeddings, the number lists that AI models produce for text and images, and finds the nearest ones to a query. It is the retrieval layer behind semantic search and retrieval-augmented generation. The six picks here sit at different points on the scale. Chroma is an easy start: one container, Python, JavaScript and Rust clients, and an index that must fit in RAM. Qdrant is a single Rust container with REST and gRPC APIs, a built-in dashboard and payload filtering. Weaviate stores objects alongside their vectors and can call embedding and generative model providers through optional modules. Milvus is built for scale, and its standalone mode runs a Milvus container plus etcd and MinIO. Those four are Apache-2.0 or BSD-3-Clause at the core, although Weaviate's wl directory holds proprietary enterprise code. pgvector is not a separate database at all: a PostgreSQL extension, under the PostgreSQL License, that adds vector columns and nearest-neighbour search beside your relational data. Vespa, Apache-2.0, takes the most setup: a search and recommendation engine that needs an application package deployed before it answers queries, with a rule-of-thumb 4 GB minimum for a single node. Size by how many vectors you will hold, since memory is the usual limit. A vector API holds your data, so keep it on a private network or behind an authenticating reverse proxy rather than on the open internet.
Vector database apps
Chroma
Milvus
pgvector
Qdrant
Vespa
Weaviate
Head-to-heads in this category
A single-node server that embeds text with a default model for you, or a Rust engine with payload filters, quantization and Raft clustering.
One Rust container with its own storage, or a Standalone stack with etcd and MinIO that scales up to Kubernetes.
Bring your own vectors to a Rust engine with a dashboard, or let a Go database call the embedding model for you.
Paid link — we earn a commission if you shop through it.
Replace a paid tool
Common questions
How much RAM do self-hosted apps in Vector database need?
Across the 6 apps in Vector database, minimums run from 512 MB (pgvector) to 8192 MB (Milvus).
Which app in Vector database uses the least RAM?
Of the 6 apps in Vector database we measured, Chroma used the least: 11 MB at idle (first boot, measured Nov 2026).
Do self-hosted apps in Vector database support Docker?
All 6 apps in Vector database list Docker support.