# Multi-SDK Benchmark Report

**Date:** 2026-03-16T07:28:41.034Z
**Duration:** 130.1s
**Runs:** 4 (2 success, 2 failed)
**Success Rate:** 50.0%

## SDK Comparison

| SDK              | Tier     | Avg Score | Avg Time | Avg Cost | Success |
| ---------------- | -------- | --------- | -------- | -------- | ------- |
| Anthropic Claude | balanced | n/a       | 1.4m     | $0.1796  | 50%     |

## Variant Rankings (by avg score)

| Rank | Variant                        | Score | Time | Cost    | Success |
| ---- | ------------------------------ | ----- | ---- | ------- | ------- |
| 1    | claude-raw-single-pass-c4408-1 | 0.0   | 0ms  | $0.0000 | 0%      |
| 2    | claude-raw-single-pass-c1-0    | n/a   | 1.4m | $0.1796 | 100%    |

## Per-Prompt Results

### Weather Card (simple)

- **Avg Score:** -1.0
- **Best:** claude-raw-single-pass-c1-0
- **Worst:** claude-raw-single-pass-c1-0

### Interactive Periodic Table (complex)

- **Avg Score:** -1.0
- **Best:** claude-raw-single-pass-c1-0
- **Worst:** claude-raw-single-pass-c1-0

## Failures

- **claude-raw-single-pass-c4408-1** × weather-card: 404 {"type":"error","error":{"type":"not_found_error","message":"model: anthropic/claude-sonnet-4-6"},"request_id":"req_011CZ6MxsQoeSk9SatFUvkL4"}
- **claude-raw-single-pass-c4408-1** × periodic-table: 404 {"type":"error","error":{"type":"not_found_error","message":"model: anthropic/claude-sonnet-4-6"},"request_id":"req_011CZ6MxuR78ZnGKcXKtYsQt"}
