Self-host Jan
Offline-first, open-source ChatGPT alternative that runs LLMs locally on the desktop (llama.cpp based, GPU-accelerated where available), with an optional self-hosted Jan Server for OpenAI-compatible API access across a team.
Key facts
Choose Jan when offline-first is the whole point — it's an Apache-2.0 app that runs LLMs locally with no account and no cloud by default, plus an optional self-hosted Jan Server for OpenAI-compatible API access across a team. It's the privacy-purist pick. If you want a browser-based, multi-user UI rather than a desktop-first app, Open WebUI is the better shape.
Follow the Jan deploy guide →What you need
- Any VPS with at least 8192 MB of RAM
- A domain you control — most self-hosted setups need HTTPS in front of them
- About an afternoon — budget time for troubleshooting
Install
Run these commands on your server:
# Jan Server — official Docker Compose self-host (janhq/server)
sudo apt-get install -y make golang-go # the quickstart builds a Go CLI
git clone https://github.com/janhq/server.git jan-server
cd jan-server
cp .env.template .env # or: make quickstart for the interactive wizard
make up-full # or make up-gpu on NVIDIA hardware → http://SERVER_IP:8000What you take on
Jan's offline-first promise is real, but it shapes what the tool is and isn't: