# Local LLMs

> Run models locally with Ollama, llama.cpp, MLX, and vLLM — privacy, cost control, and deployment flexibility.

![Status: complete](https://img.shields.io/badge/status-complete-brightgreen)

Open [`14-local-llms.ipynb`](./14-local-llms.ipynb) for learning objectives, prerequisites, and recommended reading order.

## Topics Covered

- Ollama quickstart and open-source model overview
- Local RAG with Ollama
- LLM server setup and OpenAI-compatible API
- Speculative decoding and performance considerations
- 2026 stack: MLX for Apple Silicon, vLLM and SGLang for GPU serving

## Prerequisites

[12-llm-finetuning/README.md](../12-llm-finetuning/README.md)

## What Comes Next

[30-inference-optimization/README.md](../30-inference-optimization/README.md) or [15-ai-agents/README.md](../15-ai-agents/README.md)
