Skip to main content

# Function calling (tools)

All function calling features

## 📄️ Overview

The Otoroshi LLM extension provides advanced function calling (tool calling) capabilities. The gateway can intercept LLM responses that request tool calls, execute the tools server-side, and send the results back to the LLM — all transparently to the consumer.

## 📄️ QuickJs and WASM Functions

The Otoroshi LLM extension supports two WASM-based backends for tool functions: QuickJs (JavaScript in WASM) and WasmPlugin (full WASM plugins).

## 📄️ Workflow Functions

Workflow functions allow you to use Otoroshi workflows as tool function backends. When the LLM decides to call a tool, the gateway executes the referenced workflow with the tool arguments as input and returns the workflow result to the LLM.

## 📄️ HTTP Functions

HTTP functions allow you to create tool functions that call external HTTP endpoints. When the LLM decides to call a tool, the gateway makes an HTTP request with the tool arguments and returns the response as the tool result.