---
title: "Calibrating Synthetic Judges for Model Comparison"
authors: "Park, Lena; Okafor, Sam"
year: "2026"
abstract: "A synthetic comparison of judge agreement protocols for pairwise and rubric-based model evaluation."
doi: ""
topic_cluster: "llm-evaluation-harness"
status: "deep-read"
ingested_at: "2026-04-01T10:08:00Z"
tags: ["judges", "calibration"]
labels: ["core"]
zotero-key: "SAMPLE03"
---
# Calibrating Synthetic Judges for Model Comparison

This synthetic note shows how agreement thresholds affect leaderboard stability.
