Project · Open source · Apache-2.0 and CC-BY-4.0
Agents solve olympiad and research mathematics, and Lean 4 checks the proofs. They also work on physics, chemistry, biology, programming and quantum information.
In mathematics a proof counts only if the Lean kernel accepts it. There is no partial credit.
The record
One tile per exam or board, one cell per item, filled when done. The tag says who checked it; it is not always Lean.
Each team's latest entry, from the leaderboard's data. Ties share a rank.
Each team's own figure, measured differently, so compare orders of magnitude. Two of the four reached 672 for a tenth of our cost or less.
First on the board: the first accepted proof on 30 of the 92 solved problems.
Board data from 23 October 2026. The combined 259 is our count; the board has no combined column.
IMO 2026
Two workers on two backends each proved all six in Lean. Times are API minutes, the time spent inside model calls.
What counts as solved
A problem counts only when its Lean file passes all five gates, none of them run by the model that wrote the proof. Pick a file to see where it stops.
honest.lean Passes all five gates, so it counts.
Semantic review
Does the theorem say what the problem said?
A proof Lean accepts can still prove the wrong theorem. This is checked and reported separately.
Around the gates
The worker has no network access, and neither model's workspace holds an existing PutnamBench solution. Details: the verification method, Comparator and AXLE.
With and without a flow
The models are publicly available. The flow decides who works, who reviews and what carries over between attempts.
IChO 2026 · theory subquestions accepted
Same model, with and without the review loop.
About half accepted as a plain Codex /goal; all 68 with formalization and proof review.
Where the code is
All of HOA is humanfia/hoa: one directory per competition or library, each with a README.
The flows
In humanfia/flowverse. Start with the recursive Lean prover.
The proofs, as datasets
On Hugging Face, such as IPhO 2026. For PutnamBench only a preview is public, at the authors' request.