Back to dashboard
Headline result
+20 / 50 queries newly rank-1
Method & source Mean Reciprocal Rank Voorhees (1999), TREC-8 QA Report

## Read in detail

Each card opens its own page. The headline and charts above are all you need at a glance; the cards are for the why and how.

### Aggregate

Read details →

### Paired Statistical Tests

Read details →

### Buckets

Read details →

### Method Recap

Single-token canonical-lookup queries (Class A) + framework-root queries (Class B) from scripts/eval/search-quality-phase1.py's CANONICAL_QUERIES corpus.

Read details →

### What This Measurement Does Not Capture

Same caveats as search-quality-versiondiff-v1.0.2-to-v1.2.0.md:

Read details →

### Pipeline

flowchart TD Q["50 canonical-lookup query strings<br/>(Class A + B, in-source)"]:::input R["per-query regex pattern<br/>apple-docs://&lt;framework&gt;/&lt;concept&gt;($|/...)"]:::input Q --> H[scripts/eval/search-quality…

Read details →

## Sources cited in this measurement

Every metric and method this audit relies on, with a link to the foundational source. Auto-collected from the audit text.

### Mean Reciprocal Rank

Voorhees (1999), TREC-8 QA Report

Open citation

### P@k (Precision at k)

Manning, Raghavan, Schütze (2008) IIR §8.4

Open citation

### NDCG

Järvelin & Kekäläinen (2002)

Open citation

### Wilcoxon signed-rank test

Wilcoxon (1945), Biometrics Bulletin

Open citation

### McNemar's test

McNemar (1947), Psychometrika

Open citation