# HotpotQA End-to-End Benchmark

**Date:** 2026-04-10 18:26
**Questions:** 50
**Documents:** 500
**Total Cost:** $4.16

## Overall Results

| Metric | Value |
|--------|-------|
| Document Recall | **90.0%** (90/100 supporting docs found) |
| Full Recall (both docs found) | 40/50 (80.0%) |
| Partial Recall (≥1 doc found) | 50/50 (100.0%) |
| Avg Cost/Question | $0.083 |

## By Type

| Type | Questions | Recall |
|------|-----------|--------|
| bridge | 41 | 90.2% (74/82) |
| comparison | 9 | 88.9% (16/18) |

## By Level

| Level | Questions | Recall |
|-------|-----------|--------|
| hard | 50 | 90.0% (90/100) |

## Missed Documents (worst 10)

| Question | Type | Recall | Missed |
|----------|------|--------|--------|
| What continents are the Moneuptychia found in?... | bridge | 50% | docs/Neotropical realm.md |
| Gleanntáin Ghlas' Ghaoth Dobhair is a song that can be heard... | bridge | 50% | docs/Irish pub.md |
| Who is the writer for an American teen sitcom created by Kim... | bridge | 50% | docs/King's Ransom (film).md |
| Which former mill town is near Rivington Hall Barn?... | bridge | 50% | docs/Bolton.md |
| What major city is John Bice Memorial Oval located within?... | bridge | 50% | docs/Christies Beach, South Australia.md |
| Which team based in South Wales participated in a final game... | bridge | 50% | docs/Newport County A.F.C..md |
| Which of the following is home to the 642nd Aviation Support... | comparison | 50% | docs/Valley International Airport.md |
| How far from Buenos Aires is the birthplace of Ezequiel Laza... | bridge | 50% | docs/Córdoba, Argentina.md |
| Jacques Coghen is a direct ancestor to the spouse of which B... | bridge | 50% | docs/Philippe of Belgium.md |
| Which singer/songwriter is the Executive Vice President of A... | comparison | 50% | docs/Rod Stewart.md |
