Compute-Controlled Benchmarking

Noam Brown's critique: the single-number benchmark grid is broken because it ignores test-time compute — plot performance against a cost budget instead; benchmark-maxxing, held-out private sets, the Goodhart equilibrium that keeps the grid alive, disclosure exemplars (Kimi K3's footnotes, Gemini's price rows), and the first budget-matched test of a named method class.