Jan

janhq/jan

A ChatGPT-style desktop app that runs fully offline, with built-in model downloads and the llama.cpp engine; can also switch to cloud APIs.

Why pick itThe friendliest local LLM option for people who'd rather avoid the terminal. Small Tauri build, and it doubles as a local API server.

Install

On macOS run brew install --cask jan, or download the installer for your OS from jan.ai or GitHub Releases
Open Jan and download a local model or enter a cloud API key
Start chatting, and enable the local API server when you need it

macOS 13.6+ is required, with about 8GB RAM for 3B models, 16GB for 7B and 32GB for 13B; Windows needs version 10 or later.

Summarized by AI from the project docs; check the official docs before relying on it.

rtkRun locally · ★ 84.5k
CLI proxy that reduces LLM token consumption by 60-90%
unslothRun locally · ★ 78.5k
GUI app to run and train large language models and diffusion models locally
OllamaRun locally · ★ 185k
Download and run open-weight models like Qwen, DeepSeek, Gemma and gpt-oss locally with one command, with an OpenAI-compatible API.
Open WebUIRun locally · ★ 157k
A self-hosted ChatGPT-style web UI that connects to Ollama and any OpenAI-compatible API, with built-in RAG, web search, multi-user support and MCP.
Cherry StudioRun locally · ★ 52.9k
A cross-platform desktop AI client that puts many cloud models and local Ollama in one interface, with a built-in knowledge base, MCP, agents and 300+ assistant templates.