Back to Search-quality baseline: symbol-attribute (Phase 1.6, v1.2.0 candidate)
Search-quality baseline: symbol-attribute (Phase 1.6, v1.2.0 candidate)

Method Recap

15 (query, sql_filter) pairs. For each:

  1. Compute relevant_uris = {row.doc_uri for row in doc_symbols WHERE <filter>}
  2. Run cupertino search "<query>" --limit 10
  3. Compute P@1, P@5, P@10 against relevant_uris membership

Read-only SQLite via file:...?mode=ro. No writes anywhere.

Harness source: /tmp/cupertino-search-eval-symbol-attribute.py. Full JSON dump: /tmp/cupertino-search-eval-symbol-attribute-20260520.json.