v0.1.0 Public Beta

# The Operating System
for Local Intelligence

Spin up complex AI stacks with a single command. Orchestrate LLMs, Agents, and RAG pipelines on your own hardware. No Docker headaches.

$
curl https://av.codes/get-harbor.sh | bash
Agents
OpenHands Bolt
Services
SearXNG OpenWebUI
Inference
Ollama vLLM
Llama 3 / Mistral / Qwen / Stable Diffusion / Ollama / vLLM / LangChain / LlamaIndex / OpenWebUI / Llama 3 / Mistral / Qwen / Stable Diffusion / Ollama / vLLM / LangChain / LlamaIndex / OpenWebUI /

## Everything Included

Stop fighting with Python environments. Start shipping.

### One Command Stack

Start Ollama and Open WebUI together with a single command. Defaults handle everything for you.

$ harbor up
✔ harbor.ollama Healthy
✔ harbor.webui Healthy
$ harbor open

### Model Management

Pull, list, and configure models across all backends. Works with Ollama, vLLM, llama.cpp, and more.

### Harbor App

Visual interface for managing services, monitoring resources, and configuring your stack. No terminal required.

### Powerful CLI

Configure services, manage models, view logs, and access service shells. Everything through one interface.

harbor pull harbor logs harbor config
➜ harbor ollama pull llama3.2
✔ Model pulled
➜ harbor up searxng
✔ Web search enabled

### Local Web RAG

Add SearXNG for web search and deep research. Auto-connected to Open WebUI, Perplexica, Morphic, and more.

$ harbor up searxng
✔ Web search enabled in Open WebUI
$ harbor up perplexica morphic
✔ Deep research tools ready

### Image Generation

ComfyUI + Flux pre-wired to Open WebUI. Generate images in your chat interface with a single command.

$ harbor up comfyui
✔ FLUX ready in Open WebUI

### Voice Chat

Talk to your LLM with built-in TTS and STT. Speaches provides OpenAI-compatible voice endpoints.

$ harbor up speaches
✔ Voice enabled in Open WebUI

### 100+ Services

Choose from frontends, backends, and satellites. Start, stop, and configure services with visual controls or CLI commands.

### LLM Workflows

Build complex AI workflows with Dify, n8n, Flowise, LangFlow, and more. All pre-configured and ready to use.

Dify n8n Flowise LangFlow
➜ harbor up dify
✔ Dify ready at localhost:3000
➜ harbor up n8n flowise
✔ Workflow tools ready

### Multiple Backends

Choose Ollama for simplicity, vLLM for speed, llama.cpp for efficiency. Switch backends with harbor defaults.

$ harbor defaults rm ollama
$ harbor defaults add vllm
$ harbor up
✔ vLLM backend started

### Config Profiles

Save and switch between configurations instantly. Load profiles from URLs or share with your team.

$ harbor profile save dev
$ harbor profile use prod

### 100% Private

Your data never leaves your machine. Fully air-gapped capable. No API keys required for local inference.

### MCP Tool Use

Manage Model Context Protocol servers with MetaMCP. Connect tools to Open WebUI with mcpo.

$ harbor up metamcp mcpo
✔ MCP tools connected

### Docker Native

Built on Docker Compose. Inspect with docker ps, modify compose files, or run harbor cmd for raw access.

docker ps harbor cmd compose
➜ harbor ps
ollama, webui running
➜ $(harbor cmd ollama) logs

### Chat from Phone

Print QR codes to instantly access Harbor services from your phone on your local network.

$ harbor qr
$ harbor url webui

### Chat from Anywhere

Expose services to the internet with built-in tunneling. Use cloudflared or traefik for public access.

$ harbor tunnel
✔ Tunnel established

### LLM Scripting

Harbor Boost enables custom workflow modules. Script LLM interactions with built-in quality enhancements.

$ harbor up boost
✔ LLM proxy with modules active
$ harbor config set boost.modules klmbr
✔ Creative mode enabled

### Command History

Local command history separate from shell. Lookup and re-run Harbor commands easily.

$ harbor history
harbor up searxng llamacpp

### Eject & Export

Ready to move on? Export your Harbor setup to a standalone Docker Compose file with all configs.

$ harbor eject > compose.yml
✔ Standalone stack exported

## Ready to modernize your stack?

Join thousands of engineers building the future of local AI.

Get Started Join Discord