# HotpotQA End-to-End Benchmark

**Date:** 2026-03-27 02:23
**Questions:** 500
**Documents:** 4960
**Total Cost:** $28.83

## Overall Results

| Metric | Value |
|--------|-------|
| Document Recall | **91.7%** (917/1000 supporting docs found) |
| Full Recall (both docs found) | 418/500 (83.6%) |
| Partial Recall (≥1 doc found) | 499/500 (99.8%) |
| Avg Cost/Question | $0.058 |

## By Type

| Type | Questions | Recall |
|------|-----------|--------|
| bridge | 399 | 90.9% (725/798) |
| comparison | 101 | 95.0% (192/202) |

## By Level

| Level | Questions | Recall |
|-------|-----------|--------|
| hard | 500 | 91.7% (917/1000) |

## Missed Documents (worst 10)

| Question | Type | Recall | Missed |
|----------|------|--------|--------|
| Nekeshia Shiondrail Henderson is an American former professi... | bridge | 0% | docs/Nekeshia Henderson.md, docs/Texas Longhorns women's basketball.md |
| What is one risk to Norway's financial reserve?... | bridge | 50% | docs/Forsvarets Spesialkommando.md |
| Which market town in Lancashire is part of the BB postcode a... | bridge | 50% | docs/Burnley.md |
| Gleanntáin Ghlas' Ghaoth Dobhair is a song that can be heard... | bridge | 50% | docs/Irish pub.md |
| Who is the writer for an American teen sitcom created by Kim... | bridge | 50% | docs/King's Ransom (film).md |
| The 2015 American drama film, Being Charlie, stars which Can... | bridge | 50% | docs/Devon Bostick.md |
| Which former mill town is near Rivington Hall Barn?... | bridge | 50% | docs/Bolton.md |
| Which team based in South Wales participated in a final game... | bridge | 50% | docs/Newport County A.F.C..md |
| Which of the following is home to the 642nd Aviation Support... | comparison | 50% | docs/Valley International Airport.md |
| Flyboys stars which actor who was nominated for an Academy A... | bridge | 50% | docs/James Franco.md |
