Novelty Judge Bench TRIAL

Public code and data can test whether research agents repeat existing ideas; weak labels and domain coverage still require human review.

Next stepWithin one day, score a set of existing research outputs with the public data and record false positives, misses and retrieval cost.

Judgment reviewed 2026-10-28 · Basis: Novelty Bench exposes brittle LLM research judges