---
type: crystal
cluster: llm-evaluation-harness
question_slug: sota-and-open-problems
question: "What is the current state of the art and what remains unsolved?"
based_on_papers: ["benchmark-drift", "prompt-leakage-controls", "judge-calibration"]
based_on_paper_count: 3
last_generated: 2026-04-01T12:35:00Z
generator: synthetic-sample
confidence: medium
---

# What is the current state of the art and what remains unsolved?

## TL;DR

> [!abstract] The sample state of the art is moving from static scores toward versioned harnesses with explicit uncertainty and leakage checks.

## Gist

Open problems include durable prompt privacy, judge calibration across tasks, and reporting changes when harness versions evolve.

## Full answer

The synthetic materials suggest that harnesses are strongest when they publish versioned fixtures and separate public rubrics from private test material.
