This has since moved
Three weeks later the same loop took first place with 172 problems.
Running on gpt-5.6-sol at max effort, Humanize solved 149 of 219 problems on Lean-Eval, which puts it second on the leaderboard.
First is ByteDance's Seedprover, at 155 of 219.
Six problems is not a rout in either direction, and the gap is worth naming precisely because of what is on each side of it. Seedprover is a system built for this: a prover, trained and tuned for formal mathematics. What is second is a general-purpose model driving a general-purpose agent loop, with no component anywhere in it that knows Lean specifically — the loop is the same one that runs kernel work and Kaggle competitions.
A specialist should beat a generalist on the specialist's benchmark. That it does so by six problems is the interesting number, and it is why we thought the gap was closable.