# Multi-SDK Benchmark Report

**Date:** 2026-03-16T07:40:47.937Z
**Duration:** 375.3s
**Runs:** 4 (3 success, 1 failed)
**Success Rate:** 75.0%

## SDK Comparison

| SDK              | Tier     | Avg Score | Avg Time | Avg Cost | Success |
| ---------------- | -------- | --------- | -------- | -------- | ------- |
| Anthropic Claude | balanced | n/a       | 2.0m     | $0.1873  | 75%     |

## Variant Rankings (by avg score)

| Rank | Variant                        | Score | Time | Cost    | Success |
| ---- | ------------------------------ | ----- | ---- | ------- | ------- |
| 1    | claude-raw-single-pass-c1-0    | n/a   | 1.7m | $0.2145 | 100%    |
| 2    | claude-raw-single-pass-c4835-1 | n/a   | 2.7m | $0.1330 | 50%     |

## Per-Prompt Results

### Weather Card (simple)

- **Avg Score:** -1.0
- **Best:** claude-raw-single-pass-c1-0
- **Worst:** claude-raw-single-pass-c4835-1

### Interactive Periodic Table (complex)

- **Avg Score:** -1.0
- **Best:** claude-raw-single-pass-c1-0
- **Worst:** claude-raw-single-pass-c1-0

## Failures

- **claude-raw-single-pass-c4835-1** × periodic-table: Timeout after 300000ms
