# Multi-SDK Benchmark Report

**Date:** 2026-03-22T15:15:23.171Z
**Duration:** 119.8s
**Runs:** 4 (4 success, 0 failed)
**Success Rate:** 100.0%

## SDK Comparison

| SDK              | Tier     | Avg Score | Avg Time | Avg Cost | Success |
| ---------------- | -------- | --------- | -------- | -------- | ------- |
| Anthropic Claude | balanced | 78.5      | 40.3s    | $0.1443  | 100%    |
| OpenAI           | balanced | 68.4      | 1.3m     | $0.6068  | 100%    |

## Variant Rankings (by avg score)

| Rank | Variant          | Score | Time  | Cost    | Success | Tier Eval |
| ---- | ---------------- | ----- | ----- | ------- | ------- | --------- |
| 1    | claude-default-0 | 78.5  | 40.3s | $0.1443 | 100%    | 1P/1W/0F  |
| 2    | openai-default-1 | 68.4  | 1.3m  | $0.6068 | 100%    | 1P/0W/1F  |

## Per-Commit Results

### Multi-Step Survey Form (medium)

- **Avg Score:** 82.2
- **Best:** openai-default-1
- **Worst:** claude-default-0
- **Tier Eval:** 2 pass, 0 warn, 0 fail

### Kanban Task Board (medium)

- **Avg Score:** 64.7
- **Best:** claude-default-0
- **Worst:** openai-default-1
- **Tier Eval:** 0 pass, 1 warn, 1 fail
