# Multi-SDK Benchmark Report

**Date:** 2026-03-15T00:46:42.972Z
**Duration:** 109.8s
**Runs:** 3 (2 success, 1 failed)
**Success Rate:** 66.7%

## SDK Comparison

| SDK              | Tier | Avg Score | Avg Time | Avg Cost | Success |
| ---------------- | ---- | --------- | -------- | -------- | ------- |
| Anthropic Claude | fast | n/a       | 1.0m     | $0.1504  | 100%    |
| OpenAI           | fast | n/a       | 0ms      | $0.0000  | 0%      |
| Google Gemini    | fast | n/a       | 48.3s    | $0.0047  | 100%    |

## Variant Rankings (by avg score)

| Rank | Variant      | Score | Time  | Cost    | Success |
| ---- | ------------ | ----- | ----- | ------- | ------- |
| 1    | openai-mini  | 0.0   | 0ms   | $0.0000 | 0%      |
| 2    | claude-haiku | n/a   | 1.0m  | $0.1504 | 100%    |
| 3    | google-flash | n/a   | 48.3s | $0.0047 | 100%    |

## Per-Prompt Results

### Weather Card (simple)

- **Avg Score:** -1.0
- **Best:** claude-haiku
- **Worst:** google-flash

## Failures

- **openai-mini** × weather-card: OpenAI adapter: no compiled code produced after all turns
