---
sidebar_position: 8
---

import Terminal from '@site/src/components/Terminal';

# Resilience

Resilience ensures that LLM interactions remain highly available and fault-tolerant, even when providers experience outages or failures.

## Key Features

- **Load Balancing**: Distribute requests across multiple providers to optimize performance and availability. See [Load Balancing](/docs/llm-gateway/loadbalancing).
- **Fallback Mechanism**: Automatically switch to alternative LLM providers in case of failures. See [Fallback](/docs/llm-gateway/fallback).
- **Rate Limiting & Quotas**: Prevent overloading a single provider by distributing usage effectively. See [Quotas](/docs/cost-optimizations/quotas).

## Load Balancing

The load balancer is a virtual provider that distributes requests across multiple providers using configurable strategies (round robin, random, best response time).

[Read the full Load Balancing documentation](/docs/llm-gateway/loadbalancing)

## Fallback

The fallback mechanism automatically retries failed requests on an alternative provider, ensuring service continuity.

[Read the full Fallback documentation](/docs/llm-gateway/fallback)
