# Multi-SDK Benchmark Report

**Date:** 2026-03-17T05:38:30.941Z
**Duration:** 300.0s
**Runs:** 2 (1 success, 1 failed)
**Success Rate:** 50.0%

## SDK Comparison

| SDK              | Tier     | Avg Score | Avg Time | Avg Cost | Success |
| ---------------- | -------- | --------- | -------- | -------- | ------- |
| Anthropic Claude | balanced | n/a       | 34.4s    | $0.0785  | 50%     |

## Variant Rankings (by avg score)

| Rank | Variant                  | Score | Time  | Cost    | Success |
| ---- | ------------------------ | ----- | ----- | ------- | ------- |
| 1    | claude-raw-single-pass-0 | n/a   | 34.4s | $0.0785 | 50%     |

## Per-Prompt Results

### Weather Card (simple)

- **Avg Score:** -1.0
- **Best:** claude-raw-single-pass-0
- **Worst:** claude-raw-single-pass-0

### Kanban Task Board (medium)

- **Avg Score:** 0.0
- **Best:** none
- **Worst:** none

## Failures

- **claude-raw-single-pass-0** × kanban-board: Timeout after 300000ms
