# Multi-SDK Benchmark Report

**Date:** 2026-03-19T18:34:39.540Z
**Duration:** 600.0s
**Runs:** 10 (9 success, 1 failed)
**Success Rate:** 90.0%

## SDK Comparison

| SDK           | Tier     | Avg Score | Avg Time | Avg Cost | Success |
| ------------- | -------- | --------- | -------- | -------- | ------- |
| Google Gemini | balanced | 85.0      | 2.7m     | $0.1773  | 90%     |

## Variant Rankings (by avg score)

| Rank | Variant                   | Score | Time | Cost    | Success |
| ---- | ------------------------- | ----- | ---- | ------- | ------- |
| 1    | google-single-component-0 | 90.0  | 4.0m | $0.1052 | 80%     |
| 2    | google-single-component-1 | 81.0  | 1.7m | $0.2351 | 100%    |

## Per-Commit Results

### Weather Card (simple)

- **Avg Score:** 89.5
- **Best:** google-single-component-0
- **Worst:** google-single-component-1

### Kanban Task Board (medium)

- **Avg Score:** 93.0
- **Best:** google-single-component-1
- **Worst:** google-single-component-1

### Interactive Periodic Table (complex)

- **Avg Score:** 74.5
- **Best:** google-single-component-0
- **Worst:** google-single-component-1

### E-Commerce Product Page (complex)

- **Avg Score:** 80.5
- **Best:** google-single-component-0
- **Worst:** google-single-component-1

### Onboarding Wizard (medium)

- **Avg Score:** 91.5
- **Best:** google-single-component-0
- **Worst:** google-single-component-1

## Failures

- **google-single-component-0** × kanban-board: Timeout after 600000ms
