# Multi-SDK Benchmark Report

**Date:** 2026-03-22T12:18:58.968Z
**Duration:** 113.2s
**Runs:** 8 (8 success, 0 failed)
**Success Rate:** 100.0%

## SDK Comparison

| SDK              | Tier     | Avg Score | Avg Time | Avg Cost | Success |
| ---------------- | -------- | --------- | -------- | -------- | ------- |
| Anthropic Claude | balanced | 78.0      | 1.0m     | $0.1687  | 100%    |

## Variant Rankings (by avg score)

| Rank | Variant          | Score | Time | Cost    | Success | Tier Eval |
| ---- | ---------------- | ----- | ---- | ------- | ------- | --------- |
| 1    | claude-default-0 | 78.0  | 1.0m | $0.1687 | 100%    | 0P/2W/4F  |

## Per-Commit Results

### Weather Card (simple)

- **Avg Score:** 88.0
- **Best:** claude-default-0
- **Worst:** claude-default-0
- **Tier Eval:** 0 pass, 1 warn, 0 fail

### Multi-Step Survey Form (medium)

- **Avg Score:** 86.0
- **Best:** claude-default-0
- **Worst:** claude-default-0
- **Tier Eval:** 0 pass, 0 warn, 1 fail

### Kanban Task Board (medium)

- **Avg Score:** 75.0
- **Best:** claude-default-0
- **Worst:** claude-default-0

### Interactive Periodic Table (complex)

- **Avg Score:** 63.0
- **Best:** claude-default-0
- **Worst:** claude-default-0
- **Tier Eval:** 0 pass, 0 warn, 1 fail

### E-Commerce Product Page (complex)

- **Avg Score:** 78.4
- **Best:** claude-default-0
- **Worst:** claude-default-0

### Chat Interface (medium)

- **Avg Score:** 75.0
- **Best:** claude-default-0
- **Worst:** claude-default-0
- **Tier Eval:** 0 pass, 0 warn, 1 fail

### Stock Ticker Dashboard (simple)

- **Avg Score:** 80.0
- **Best:** claude-default-0
- **Worst:** claude-default-0
- **Tier Eval:** 0 pass, 0 warn, 1 fail

### Onboarding Wizard (medium)

- **Avg Score:** 79.0
- **Best:** claude-default-0
- **Worst:** claude-default-0
- **Tier Eval:** 0 pass, 1 warn, 0 fail
